Skip to main content

Module evaluator

Module evaluator 

Source
Expand description

Model Evaluator for standardized evaluation and comparison

Provides ModelEvaluator for running comprehensive evaluations, comparing multiple models, and generating leaderboards.

Structs§

EvalConfig
Configuration for model evaluation
EvalResult
Model evaluation results
KFold
K-Fold cross-validation splitter
Leaderboard
Leaderboard for comparing multiple models
ModelEvaluator
Model Evaluator for running evaluations

Enums§

Metric
Available evaluation metrics
RougeVariant
ROUGE variant for text generation evaluation