Enum SamplingStrategy 

pub enum SamplingStrategy {
    Greedy,
    Temperature(f32),
    TopK {
        k: usize,
        temperature: f32,
    },
    TopP {
        p: f32,
        temperature: f32,
    },
    Combined {
        top_k: usize,
        top_p: f32,
        temperature: f32,
        repetition_penalty: f32,
    },
}

Variants

Greedy

Always pick the argmax token — fastest, deterministic.

Temperature(f32)

Sample with temperature scaling.

TopK

Sample from the top-k highest probability tokens.

Fields

k: usize

temperature: f32

TopP

Nucleus sampling — sample from the minimum set covering probability p.

Fields

p: f32

temperature: f32

Combined

Combined top-k + top-p + temperature.

Fields

top_k: usize

top_p: f32

temperature: f32

repetition_penalty: f32

Trait Implementations

impl Clone for SamplingStrategy

fn clone(&self) -> SamplingStrategy

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SamplingStrategy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SamplingStrategy

fn default() -> Self

Returns the “default value” for a type.