Workflow & Validation

Stopping Criteria

Definition

The pre-defined rules that determine when a TAR review is considered complete.

Why it matters

Defensibility often turns on whether these were set in advance and met.

In practice

Stopping criteria are the rules for deciding when review is finished. Common ingredients include batch yield falling below a set rate for several consecutive batches, a recall estimate meeting a target, and a validation sample that confirms the result.

Criteria set in advance, written down and applied as written are easier to explain than a decision made once review was underway. Many ESI protocols address stopping and validation explicitly.

What counts as reasonable depends on the matter: the volume, the importance of the issues, and what the parties have agreed. This glossary describes common practice and is not legal advice.

Worked example

A team agrees to consider stopping when three consecutive review batches of 1,000 documents are each under 2% responsive, then to draw a 1,500-document elusion sample from the unreviewed documents and report estimated recall with its interval.

Illustrative numbers, not from a real matter.

Compare with

  • Stabilization: Stabilization describes the model; stopping criteria describe the review decision.
← Back to glossary