Struct DecodingStats 

pub struct DecodingStats {
    pub total_tokens: usize,
    pub draft_tokens: usize,
    pub accepted_tokens: usize,
    pub wall_time_ms: f64,
    pub tokens_per_step: f64,
}

Aggregate statistics collected during a full speculative decoding run.

Fields

total_tokens: usize

Total number of tokens produced (final output length minus prompt length).

draft_tokens: usize

Total number of draft tokens proposed across all steps.

accepted_tokens: usize

Total number of draft tokens accepted across all steps.

wall_time_ms: f64

Wall-clock time for the decoding run, in milliseconds.

tokens_per_step: f64

Average number of tokens produced per decoding step.

For pure autoregressive decoding this is 1.0; speculative decoding aims for values > 1.0.

Implementations

impl DecodingStats

pub fn new() -> Self

Create empty statistics.

pub fn acceptance_rate(&self) -> f64

Overall acceptance rate across the entire decoding run.

pub fn throughput(&self) -> f64

Tokens generated per millisecond.

Trait Implementations

impl Clone for DecodingStats

fn clone(&self) -> DecodingStats

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for DecodingStats

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for DecodingStats

fn default() -> Self

Returns the “default value” for a type.

impl Display for DecodingStats

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.