Struct llama_cpp::Token

#[repr(transparent)]
pub struct Token(pub i32);

A single token produced or consumed by a LlamaModel, without its associated context.

Due to the layout of llama.cpp, these can be created from a LlamaModel, but require a LlamaSession to decode.

On its own, this isn’t useful for anything other than being fed into LlamaSession::advance_context_with_tokens.

Tuple Fields

0: i32

Trait Implementations

impl<'a> AsRef<Token> for CompletionToken<'a>

fn as_ref(&self) -> &Token

Converts this type into a shared reference of the (usually inferred) input type.

impl Clone for Token

fn clone(&self) -> Token

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Token

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for Token

fn eq(&self, other: &Token) -> bool

This method tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

This method tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for Token

impl Eq for Token

impl StructuralEq for Token

impl StructuralPartialEq for Token