Struct Inputs 

pub struct Inputs<'a> {
    pub manifest: &'a DatasetManifest,
    pub split: Split,
    pub config: &'a EvaluatorConfig,
    pub adapter: &'a dyn TaskAdapter,
    pub bundles: &'a BTreeMap<String, BundleInput>,
    pub resolver: &'a dyn Resolver,
    pub replay: &'a ReplayConfig,
    pub candidate: Option<Candidate<'a>>,
}

What one evaluation takes.

Fields

manifest: &'a DatasetManifest

split: Split

config: &'a EvaluatorConfig

adapter: &'a dyn TaskAdapter

bundles: &'a BTreeMap<String, BundleInput>

By case id: a parsed bundle or the load failure the host observed (spec 015). A case with no entry is bundle-missing.

resolver: &'a dyn Resolver

replay: &'a ReplayConfig

candidate: Option<Candidate<'a>>

A candidate plan to compare; none for a baseline report.