Struct OnlinePerplexity 

pub struct OnlinePerplexity { /* private fields */ }

Running perplexity estimator: accumulates Σ log_p and token count, and reports exp(-mean_neg_log_p) on demand.

Feeding tokens one at a time yields exactly the same value as the batch crate::perplexity::PerplexityEvaluator::compute call at the end, up to f32 accumulation order.

Implementations

impl OnlinePerplexity

pub fn new() -> Self

Construct a fresh estimator.

pub fn push(&mut self, log_p: f32)

Feed a single log-probability (natural log).

pub fn push_chunk(&mut self, log_ps: &[f32])

Feed a chunk of log-probabilities.

pub fn reset(&mut self)

Reset the state (zero tokens, zero sum).

pub fn tokens(&self) -> usize

Number of tokens seen.

pub fn current(&self) -> f32

Current perplexity estimate; f32::INFINITY if no tokens have been seen.

Trait Implementations

impl Clone for OnlinePerplexity

fn clone(&self) -> OnlinePerplexity

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for OnlinePerplexity

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for OnlinePerplexity

fn default() -> OnlinePerplexity

Returns the “default value” for a type.

impl Serialize for OnlinePerplexity

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.