Expand description
bleuscore is a BLEU score calculator written in pure rust.
§Install:
The crate is called bleuscore and you can depend on it via cargo:
[dependencies]
bleuscore = "*"§Features:
- Tokenized BLEU score calculation like huggingface evaluate.
§Basic usage:
use bleuscore::{compute_score, RefLenMethod};
// get the references and prediction data:
let references: Vec<Vec<String>> = vec![vec!["Hello, World!".to_string()]];
let predictions: Vec<String> = vec!["Yellow, World!".to_string()];
// set the parameters:
let max_order: usize = 4;
let smooth: bool = true;
// calculate the BLEU score:
let res = compute_score(
&references,
&predictions,
max_order,
smooth,
RefLenMethod::Shortest,
);
println!("result: {:?}", res);
// result: BleuScore { bleu: 0.668740304976422, precisions: [0.8, 0.75, 0.6666666666666666, 0.5],
// brevity_penalty: 1.0, length_ratio: 1.0, translation_length: 4, reference_length: 4 }!
Re-exports§
pub use bleu::compute_score;pub use bleu::RefLenMethod;