Struct EvaluationRunner 

pub struct EvaluationRunner { /* private fields */ }

Concurrent deterministic evaluation orchestrator.

Implementations

impl EvaluationRunner

pub fn new(target: impl EvaluationTarget + 'static) -> Self

Creates a runner with sequential case execution.

pub fn with_scorer(self, scorer: impl EvaluationScorer + 'static) -> Self

Adds one scorer.

pub const fn with_concurrency(self, concurrency: NonZeroUsize) -> Self

Bounds concurrently executing cases.

pub async fn run( &self, dataset: &EvaluationDataset, candidate_version: impl Into<String>, ) -> Result<EvaluationReport, EvaluationError>

Evaluates all cases and returns a stable output-free report.

Target and scorer failures are captured per case rather than cancelling unrelated cases.

Errors

Returns an error when candidate_version is empty.

Trait Implementations

impl Debug for EvaluationRunner

fn fmt(&self, formatter: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.