Enum SamplerStep 

pub enum SamplerStep {
    Temperature(f32),
    RepetitionPenalty {
        penalty: f32,
        last_n: usize,
        tokens: Vec<u32>,
    },
    TopK(usize),
    TopP(f32),
    MinP(f32),
    Typical(f32),
    Mirostat2 {
        tau: f32,
        eta: f32,
    },
    Greedy,
}

A single step in a SamplerChain pipeline.

Steps are applied in order to the logit vector before final sampling.

Variants

Temperature(f32)

Divide logits by temperature. Values near 0 produce near-greedy output.

RepetitionPenalty

Penalise previously-seen tokens to reduce repetition.

Fields

penalty: f32

Penalty multiplier (>1.0 discourages repetition).

last_n: usize

Number of recent tokens to consider (window).

tokens: Vec<u32>

The recent token ids to penalise.

TopK(usize)

Keep only the top-k highest-logit candidates.

TopP(f32)

Nucleus (top-p) filtering.

MinP(f32)

Min-P filtering (min fraction of top token probability).

Typical(f32)

Locally typical sampling with probability mass p.

Mirostat2

Mirostat v2 with given tau and eta.

Fields

tau: f32

Target surprise (bits).

eta: f32

Learning rate.

Greedy

Always pick the argmax (no randomness).

Trait Implementations

impl Clone for SamplerStep

fn clone(&self) -> SamplerStep

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SamplerStep

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.