Struct TokenCommit 

pub struct TokenCommit {
    pub token_id: u32,
    pub position: usize,
    pub finish_reason: Option<FinishReason>,
}

Result of one canonical token commit.

Fields

token_id: u32

Token id committed to the logical output.

position: usize

Zero-based generated-token position.

finish_reason: Option<FinishReason>

Terminal reason selected after this commit, if any.

Trait Implementations

impl Clone for TokenCommit

fn clone(&self) -> TokenCommit

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for TokenCommit

impl Debug for TokenCommit

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for TokenCommit

impl PartialEq for TokenCommit

fn eq(&self, other: &TokenCommit) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for TokenCommit