Struct LlamaTokenDataArray 

pub struct LlamaTokenDataArray {
    pub data: Vec<LlamaTokenData>,
    pub selected: Option<usize>,
    pub sorted: bool,
}

A safe wrapper around llama_token_data_array — the candidate set consumed (and mutated) by sampling.

Fields

data: Vec<LlamaTokenData>

The underlying candidate data.

selected: Option<usize>

The index of the selected token in data, if a sampler has chosen one.

sorted: bool

Whether data is sorted by logit (descending).

Implementations

impl LlamaTokenDataArray

pub fn new(data: Vec<LlamaTokenData>, sorted: bool) -> Self

Create a new LlamaTokenDataArray from a vector and whether the data is sorted by logit.

pub fn from_iter<T>(data: T, sorted: bool) -> LlamaTokenDataArray

where T: IntoIterator<Item = LlamaTokenData>,

Create a new LlamaTokenDataArray from an iterator of LlamaTokenData.

pub fn from_logits(logits: &[f32]) -> Self

Build from a logits slice (id = index). Probabilities start at 0 and the data is unsorted.

pub fn selected_token(&self) -> Option<LlamaToken>

The currently selected token, if a sampler has chosen one.

pub fn apply_repetition_penalties( &mut self, ctx: &mut LlamaContext<'_>, last_tokens: &[LlamaToken], penalty_repeat: f32, penalty_freq: f32, penalty_present: f32, )

Apply repetition / frequency / presence penalties in place over the most recent last_tokens.

Wraps ik’s legacy llama_sample_repetition_penalties. An empty last_tokens slice is a no-op. Logits are mutated in place; candidate order is preserved.

Trait Implementations

impl Clone for LlamaTokenDataArray

fn clone(&self) -> LlamaTokenDataArray

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LlamaTokenDataArray

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for LlamaTokenDataArray

fn eq(&self, other: &LlamaTokenDataArray) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for LlamaTokenDataArray