Skip to main content

Module generative

Module generative 

Source
Expand description

Generative AI evaluation metrics

Metrics for evaluating generative models across domains:

  • ASR: Word Error Rate (WER), Real-Time Factor inverse (RTFx)
  • Text Generation: BLEU, ROUGE (1/2/L), Perplexity
  • Code Generation: pass@k
  • Retrieval: NDCG@k

Re-exports§

pub use asr::real_time_factor_inverse;
pub use asr::word_error_rate;
pub use code::pass_at_k;
pub use retrieval::ndcg_at_k;
pub use text_gen::bleu_score;
pub use text_gen::perplexity;
pub use text_gen::rouge_l;
pub use text_gen::rouge_n;

Modules§

asr
Automatic Speech Recognition (ASR) evaluation metrics
code
Code generation evaluation metrics
retrieval
Information retrieval evaluation metrics
text_gen
Text generation evaluation metrics