Skip to main content

measure

Function measure 

Source
pub fn measure(
    frozen: &Frozen,
    admission: Option<&Admitted>,
    manifest: &DatasetManifest,
    reports: &[(Role, &Evaluated)],
) -> Result<Measurement, QualificationError>
Expand description

Measure a frozen qualification from spec 004 reports of its roles on the final-test split (spec 023, 3.4). Every report must be of the admitted dataset, the final-test split, every final-test case and the frozen configuration and bindings; a report under another configuration is QualificationError::ConfigChanged. Exposed cases are counted apart and keep every accuracy and probability figure unknown, since a spec 004 report cannot leave them out. A slice below its frozen minimum, and a headline below the sample-size target, is unknown, never a figure.