Struct Sampler 

pub struct Sampler { /* private fields */ }

Stateful sampler that maintains PRNG state across calls.

Implementations

impl Sampler

pub fn new(config: SamplerConfig) -> Self

Create a new sampler with the given config.

pub fn sample(&mut self, logits: &[f32], recent_tokens: &[u32]) -> u32

Sample a token ID from logits.

pub fn reset_grammar(&mut self)

Reset the grammar state to the beginning (use for a new generation).

pub fn grammar_complete(&self) -> bool

Returns true when the grammar (if any) is in a valid accepting state.

pub fn config(&self) -> &SamplerConfig

Get a reference to the config.

pub fn rng_state(&self) -> u64

Return the raw RNG state for snapshot/resume.

pub fn mirostat_mu_value(&self) -> f32

Return the current mirostat mu value for snapshot/resume.

pub fn restore_rng_state(&mut self, state: u64, mu: f32)

Restore the RNG state and mirostat mu (for resume).