Struct LlamaTokenData 

pub struct LlamaTokenData { /* private fields */ }

A transparent wrapper around llama_token_data (a token id + its logit and probability).

Do not rely on repr(transparent) for this type — it is an implementation detail (it lets [LlamaTokenData] be reinterpreted as [llama_token_data] for the C sampling calls) and may change.

Implementations

impl LlamaTokenData

pub fn new(LlamaToken: LlamaToken, logit: f32, p: f32) -> Self

Create a new token data from a token, logit, and probability.

pub fn id(&self) -> LlamaToken

The token’s id.

pub fn logit(&self) -> f32

The token’s logit.

pub fn p(&self) -> f32

The token’s probability.

pub fn set_id(&mut self, id: LlamaToken)

Set the token’s id.

pub fn set_logit(&mut self, logit: f32)

Set the token’s logit.

pub fn set_p(&mut self, p: f32)

Set the token’s probability.

Trait Implementations

impl Clone for LlamaTokenData

fn clone(&self) -> LlamaTokenData

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for LlamaTokenData

impl Debug for LlamaTokenData

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for LlamaTokenData

fn eq(&self, other: &LlamaTokenData) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for LlamaTokenData