pub fn measure(
frozen: &Frozen,
admission: Option<&Admitted>,
manifest: &DatasetManifest,
reports: &[(Role, &Evaluated)],
) -> Result<Measurement, QualificationError>Expand description
Measure a frozen qualification from spec 004 reports of its roles on the
final-test split (spec 023, 3.4). Every report must be of the admitted
dataset, the final-test split, every final-test case and the frozen
configuration and bindings; a report under another configuration is
QualificationError::ConfigChanged. Exposed cases are counted apart
and keep every accuracy and probability figure unknown, since a spec 004
report cannot leave them out. A slice below its frozen minimum, and a
headline below the sample-size target, is unknown, never a figure.