Struct ObservedInputs 

pub struct ObservedInputs<'a> {
    pub manifest: &'a DatasetManifest,
    pub split: Split,
    pub config: &'a EvaluatorConfig,
    pub adapter: &'a dyn TaskAdapter,
    pub observations: &'a BTreeMap<String, Observation>,
    pub plan: &'a Plan,
}

Inputs to pure, synchronous evaluation of observed results.

Fields

manifest: &'a DatasetManifest

split: Split

config: &'a EvaluatorConfig

adapter: &'a dyn TaskAdapter

observations: &'a BTreeMap<String, Observation>

plan: &'a Plan

Identifies the evaluated plan when no case is comparable.