Skip to main content

HOLDOUT_TOLERANCE

Constant HOLDOUT_TOLERANCE 

Source
pub const HOLDOUT_TOLERANCE: f64 = 0.05;
Expand description

Holdout verdict tolerance: the validation corpus may lag the development corpus by up to this much (overall recall, absolute) before the run is called OVERFIT. The band absorbs corpus-difficulty, LOC-mix, and ground-truth-strictness differences; a lag beyond it means the development-tuned rules do not generalize to unseen repos.