Struct Sampler 

pub struct Sampler {
    pub temperature: f32,
    pub top_k: Option<usize>,
    pub top_p: Option<f32>,
    pub repetition_penalty: Option<f32>,
    /* private fields */
}

Sampling configuration and strategy.

Fields

temperature: f32

Temperature for softmax scaling. > 1.0 = more random, < 1.0 = more deterministic.

top_k: Option<usize>

Top-k: only sample from top k logits.

top_p: Option<f32>

Top-p (nucleus sampling): sample from smallest set of tokens with cumulative prob >= p.

repetition_penalty: Option<f32>

Repetition penalty: penalize tokens that appear in history.

Implementations

impl Sampler

pub fn new() -> Self

Create a sampler with default settings (greedy).

pub fn with_temperature(self, temp: f32) -> Self

pub fn with_top_k(self, k: usize) -> Self

pub fn with_top_p(self, p: f32) -> Self

pub fn with_repetition_penalty(self, penalty: f32) -> Self

pub fn with_seed(self, seed: u64) -> Self

pub fn sample(&mut self, logits: &[f32]) -> SamplingResult<usize>

Sample a token index from logits using configured strategy.

pub fn sample_with_history( &mut self, logits: &[f32], history: &[usize], ) -> SamplingResult<usize>

Sample with history for repetition penalty.

Trait Implementations

impl Clone for Sampler

fn clone(&self) -> Sampler

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Sampler

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for Sampler

fn default() -> Self

Returns the “default value” for a type.