Struct DraftBlock 

pub struct DraftBlock { /* private fields */ }

A block of drafted tokens plus, per position, the distribution that position was drawn from.

tokens and dists are the same length by construction: the verification rule needs q for every token it might have to reject, so a block that carried tokens without distributions could not be verified losslessly at all.

Implementations

impl DraftBlock

pub fn empty() -> Self

pub fn new(tokens: Vec<usize>, dists: Vec<DraftDist>) -> Self

Panics if the two vectors disagree in length – an unverifiable block is a programming error in the drafter, not a runtime condition to degrade around.

pub fn deterministic(tokens: Vec<usize>) -> Self

A block from a drafter that has no distribution to offer: every position is reported as certain. Correct (and lossless) for a lookup drafter; wrong for a model-based one, which must report its real softmax.

pub fn tokens(&self) -> &[usize]

pub fn dists(&self) -> &[DraftDist]

pub fn len(&self) -> usize

pub fn is_empty(&self) -> bool

pub fn truncate(&mut self, len: usize)

Drops everything past len positions, keeping tokens and distributions in step.

Trait Implementations

impl Clone for DraftBlock

fn clone(&self) -> DraftBlock

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for DraftBlock

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for DraftBlock

fn default() -> DraftBlock

Returns the “default value” for a type.

impl PartialEq for DraftBlock

fn eq(&self, other: &DraftBlock) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for DraftBlock