pub fn evaluate(
dataset: &DynamicDataset,
config: &DynamicEvaluatorConfig,
capability: &DynamicCapability,
split: Split,
outcomes: &BTreeMap<String, DynamicOutcome>,
) -> Result<DynamicEvalReport, DynamicEvalError>Expand description
Evaluate retained outcomes of one split against a dynamic dataset (3.7).
outcomes maps case ids to retained outcomes; a missing outcome or one
that does not reproduce is listed as incomparable and left out of every
denominator. Nothing is dispatched.