pub struct Bleu { /* private fields */ }Expand description
BLEU 评测器(默认 BLEU-4)。
Implementations§
Source§impl Bleu
impl Bleu
pub fn new() -> Self
Sourcepub fn with_max_n(self, n: usize) -> Self
pub fn with_max_n(self, n: usize) -> Self
使用 BLEU-n(默认 4)
Sourcepub fn with_char_level(self, v: bool) -> Self
pub fn with_char_level(self, v: bool) -> Self
字符级分词:中文等无空格语言按字符切(否则整句成一个 token,BLEU 失效)
Sourcepub fn with_smoothing(self, v: bool) -> Self
pub fn with_smoothing(self, v: bool) -> Self
开启平滑:某阶 n-gram 无匹配时给小值而非整体归零,短句不被一刀切
Sourcepub fn corpus_bleu(&self, predictions: &[&str], references: &[&str]) -> f64
pub fn corpus_bleu(&self, predictions: &[&str], references: &[&str]) -> f64
corpus 级 BLEU:跨多条样例聚合 n-gram 匹配计数,再整体算几何均值 + corpus 级 brevity penalty。
P2-1:句子级 BLEU 的 brevity penalty 会把短句一刀切(如 BLEU-4 下
“the cat” 直接归零);corpus 聚合用总长度算惩罚、各阶 n-gram 计数合并,
短句的匹配仍能贡献低阶精度。开启 with_smoothing 后某阶无匹配给小值
而非整体归零。
predictions 与 references 长度必须一致(逐条对应),否则 panic。
Trait Implementations§
Source§impl Evaluator for Bleu
impl Evaluator for Bleu
Source§fn eval<'life0, 'life1, 'life2, 'life3, 'async_trait>(
&'life0 self,
_input: &'life1 str,
prediction: &'life2 str,
reference: &'life3 str,
) -> Pin<Box<dyn Future<Output = Result<Score, EvalError>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
'life1: 'async_trait,
'life2: 'async_trait,
'life3: 'async_trait,
fn eval<'life0, 'life1, 'life2, 'life3, 'async_trait>(
&'life0 self,
_input: &'life1 str,
prediction: &'life2 str,
reference: &'life3 str,
) -> Pin<Box<dyn Future<Output = Result<Score, EvalError>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
'life1: 'async_trait,
'life2: 'async_trait,
'life3: 'async_trait,
对单条预测打分
Auto Trait Implementations§
impl Freeze for Bleu
impl RefUnwindSafe for Bleu
impl Send for Bleu
impl Sync for Bleu
impl Unpin for Bleu
impl UnsafeUnpin for Bleu
impl UnwindSafe for Bleu
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more