Struct AcceptDecision 

pub struct AcceptDecision {
    pub accepted: Vec<u32>,
    pub corrected: Option<u32>,
}

Outcome of one speculative-decoding round.

Fields

accepted: Vec<u32>

Tokens accepted. Length is 0..=n.

corrected: Option<u32>

One extra token sampled from the target’s distribution after rejection — None only when all n are accepted. Either way the round produces accepted.len() + 1 real tokens (the +1 is corrected or a final target sample).

Implementations

impl AcceptDecision

pub fn total_tokens(&self) -> usize

Total real tokens this round produced.

Trait Implementations

impl Clone for AcceptDecision

fn clone(&self) -> AcceptDecision

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for AcceptDecision

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.