Enum Metric 

pub enum Metric {
    Accuracy,
    Precision(Average),
    Recall(Average),
    F1(Average),
    R2,
    MSE,
    MAE,
    RMSE,
    Silhouette,
    Inertia,
    WER,
    RTFx,
    BLEU,
    ROUGE(RougeVariant),
    Perplexity,
    MMLUAccuracy,
    PassAtK(usize),
    NDCGAtK(usize),
}

Available evaluation metrics

Variants

Accuracy

Classification accuracy

Precision(Average)

Precision with averaging strategy

Recall(Average)

Recall with averaging strategy

F1(Average)

F1 score with averaging strategy

R2

R² coefficient of determination

MSE

Mean Squared Error

MAE

Mean Absolute Error

RMSE

Root Mean Squared Error

Silhouette

Silhouette score

Inertia

Inertia

WER

Word Error Rate (lower is better)

RTFx

Inverse Real-Time Factor (higher is better: RTFx=100 means 100x real-time)

BLEU

BLEU score (higher is better)

ROUGE(RougeVariant)

ROUGE score with variant (higher is better)

Perplexity

Perplexity (lower is better)

MMLUAccuracy

MMLU accuracy (higher is better, covers MMLU-PRO, BBH, etc.)

PassAtK(usize)

pass@k — unbiased estimator, parameterized by k (higher is better)

NDCGAtK(usize)

NDCG@k — normalized discounted cumulative gain (higher is better)

Implementations

impl Metric

pub fn higher_is_better(&self) -> bool

Whether higher values are better for this metric

pub fn name(&self) -> &'static str

Get metric name as string

Trait Implementations

impl Clone for Metric

fn clone(&self) -> Metric

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Metric

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for Metric

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Hash for Metric

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for Metric

fn eq(&self, other: &Metric) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for Metric

impl Eq for Metric

impl StructuralPartialEq for Metric