Struct TypicalSampler 

pub struct TypicalSampler {
    pub p: f32,
    pub min_keep: usize,
}

Locally Typical sampling (Meister et al., “Locally Typical Sampling”, 2023).

Keeps the smallest set of tokens whose information content is closest to the conditional entropy of the distribution, summing to at least p probability mass.

Fields

p: f32

Cumulative probability mass to retain. Default: 0.9.

min_keep: usize

Minimum number of candidates to keep regardless of p. Default: 1.

Implementations

impl TypicalSampler

pub fn new(p: f32, min_keep: usize) -> Self

Create a new typical sampler.

pub fn sample(&self, logits: &[f32], rng: &mut LcgRng) -> usize

Sample a token index from raw logits.

Trait Implementations

impl Clone for TypicalSampler

fn clone(&self) -> TypicalSampler

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TypicalSampler

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.