Struct SampleOpts 

pub struct SampleOpts {
    pub temperature: f32,
    pub top_k: usize,
    pub top_p: f32,
    pub seed: u64,
    pub greedy: bool,
}

Sampling configuration. Construct via SampleOpts::greedy / SampleOpts::temperature or build manually.

Order of operations matches HF transformers defaults:

1. temperature divides logits (skipped if <= 0 or 1.0).
2. top_k truncates to the K highest-logit tokens (0 = disabled).
3. top_p truncates by nucleus cumulative-mass cutoff (1.0 = disabled).
4. Softmax + multinomial sample (or argmax when greedy).

Fields

temperature: f32

top_k: usize

top_p: f32

seed: u64

greedy: bool

Implementations

impl SampleOpts

pub fn greedy() -> SampleOpts

pub fn temperature(temp: f32, seed: u64) -> SampleOpts

pub fn with_top_k(self, k: usize) -> SampleOpts

pub fn with_top_p(self, p: f32) -> SampleOpts

Trait Implementations

impl Clone for SampleOpts

fn clone(&self) -> SampleOpts

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SampleOpts

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Copy for SampleOpts