Struct SamplerConfig 

pub struct SamplerConfig {
    pub temperature: f32,
    pub top_k: usize,
    pub top_p: f32,
    pub min_p: f32,
    pub typical_p: f32,
    pub repeat_penalty: f32,
    pub repeat_window: usize,
    pub frequency_penalty: f32,
    pub presence_penalty: f32,
    pub seed: Option<u64>,
    pub mirostat: Option<MirostatConfig>,
}

Sampler configuration

Fields

temperature: f32

Temperature for softmax scaling (higher = more random)

top_k: usize

Top-K: only consider the K most likely tokens

top_p: f32

Top-P (nucleus): only consider tokens with cumulative probability <= p

min_p: f32

Min-P: only consider tokens with probability >= min_p * max_prob

typical_p: f32

Typical-P sampling

repeat_penalty: f32

Repetition penalty

repeat_window: usize

Window size for repetition penalty

frequency_penalty: f32

Frequency penalty

presence_penalty: f32

Presence penalty

seed: Option<u64>

Random seed (None for random)

mirostat: Option<MirostatConfig>

Mirostat sampling (overrides other sampling methods if set)

Implementations

impl SamplerConfig

pub fn greedy() -> Self

Create a greedy sampling config (always picks most likely token)

pub fn creative() -> Self

Create a creative sampling config

pub fn mirostat_v2(tau: f32, eta: f32) -> Self

Create a Mirostat v2 sampling config

Trait Implementations

impl Clone for SamplerConfig

fn clone(&self) -> SamplerConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SamplerConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SamplerConfig

fn default() -> Self

Returns the “default value” for a type.