pub struct MultiRunEvaluator { /* private fields */ }Expand description
Multi-run evaluator for NER models.
Runs evaluation multiple times and aggregates results with statistics.
Implementations§
Source§impl MultiRunEvaluator
impl MultiRunEvaluator
Sourcepub fn new(config: MultiRunConfig) -> Self
pub fn new(config: MultiRunConfig) -> Self
Create a new evaluator with the given config.
Sourcepub fn default_config() -> Self
pub fn default_config() -> Self
Create with default config.
Sourcepub fn evaluate(
&self,
model: &dyn Model,
test_cases: &[(String, Vec<GoldEntity>)],
) -> Result<MultiRunResults>
pub fn evaluate( &self, model: &dyn Model, test_cases: &[(String, Vec<GoldEntity>)], ) -> Result<MultiRunResults>
Evaluate a model on test cases with multiple runs.
Sourcepub fn quick_eval(
model: &dyn Model,
test_cases: &[(String, Vec<GoldEntity>)],
) -> Result<MultiRunResults>
pub fn quick_eval( model: &dyn Model, test_cases: &[(String, Vec<GoldEntity>)], ) -> Result<MultiRunResults>
Quick evaluation with 3 runs (suitable for development).
Sourcepub fn thorough_eval(
model: &dyn Model,
test_cases: &[(String, Vec<GoldEntity>)],
) -> Result<MultiRunResults>
pub fn thorough_eval( model: &dyn Model, test_cases: &[(String, Vec<GoldEntity>)], ) -> Result<MultiRunResults>
Thorough evaluation with 10 runs (suitable for publication).
Trait Implementations§
Source§impl Clone for MultiRunEvaluator
impl Clone for MultiRunEvaluator
Source§fn clone(&self) -> MultiRunEvaluator
fn clone(&self) -> MultiRunEvaluator
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreAuto Trait Implementations§
impl Freeze for MultiRunEvaluator
impl RefUnwindSafe for MultiRunEvaluator
impl Send for MultiRunEvaluator
impl Sync for MultiRunEvaluator
impl Unpin for MultiRunEvaluator
impl UnsafeUnpin for MultiRunEvaluator
impl UnwindSafe for MultiRunEvaluator
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> ErasedDestructor for Twhere
T: 'static,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more