Metrics
Elusion Rate
Definition
The proportion of documents in the discarded set that are actually responsive, estimated from a sample.
Why it matters
It quantifies what a culling decision left behind and is central to defensibility.
In practice
The elusion rate is the proportion of responsive documents in the set that review left behind, estimated from a random sample of that set.
A low rate on a very large set can still mean many missed documents, so the rate is most useful multiplied by the size of the set it came from.
Because responsive documents in a discard set are usually rare, elusion samples often find only a handful of them. Report the interval, not just the point estimate.
Formula
Elusion rate = responsive documents in the sample ÷ documents in the sample
Worked example
A discard set holds 50,000 documents. A random sample of 400 finds 2 responsive, an elusion rate of 0.5%, which projects to about 250 responsive documents left in the set.
Illustrative numbers, not from a real matter.
Compare with
- Elusion: Elusion is the sampling test; elusion rate is its result.
- Prevalence: Prevalence is measured across the whole collection; elusion rate only in what was set aside.
Work it out
- Culling Impact calculator · Did culling remove noise without losing responsive documents?
- Elusion & Recall calculator · What did we leave behind, and what recall can we defend?