Struct EvaluatorBuilder 

pub struct EvaluatorBuilder<B: Backend, TI, TO: ItemLazy> { /* private fields */ }

Struct to configure and create an evaluator.

The generics components of the builder should probably not be set manually, as they are optimized for Rust type inference.

Implementations

impl<B: Backend, TI, TO: ItemLazy + 'static> EvaluatorBuilder<B, TI, TO>

pub fn new(directory: impl AsRef<Path>) -> Self

Creates a new evaluator builder.

Arguments

• directory - The directory to save the checkpoints.

pub fn metrics<M: EvalMetricRegistration<TI, TO>>(self, metrics: M) -> Self

Registers numeric test metrics.

pub fn metrics_text<M: EvalTextMetricRegistration<TI, TO>>( self, metrics: M, ) -> Self

Registers text metrics.

pub fn with_application_logger( self, logger: Option<Box<dyn ApplicationLoggerInstaller>>, ) -> Self

By default, Rust logs are captured and written into evaluation.log. If disabled, standard Rust log handling will apply.

pub fn metric_numeric<Me: Metric + Numeric + 'static>(self, metric: Me) -> Self

where <TO as ItemLazy>::ItemSync: Adaptor<Me::Input>,

Register a numeric test metric.

pub fn metric<Me: Metric + 'static>(self, metric: Me) -> Self

where <TO as ItemLazy>::ItemSync: Adaptor<Me::Input>,

Register a text test metric.

pub fn renderer(self, renderer: Box<dyn MetricsRenderer + 'static>) -> Self

Replace the default CLI renderer with a custom one.

Arguments

• renderer - The custom renderer.

pub fn summary(self) -> Self

Enable the evaluation summary report.

The summary will be displayed at the end of .eval().

pub fn build<M>( self, model: M, ) -> Evaluator<EvaluatorComponentTypesMarker<B, M, AsyncProcessorEvaluation<FullEventProcessorEvaluation<TO>>, TI, TO>>

where TI: Send + 'static, M: Module<B> + TestStep<TI, TO> + Display + 'static,

Builds the evaluator.