Struct Sampler 

pub struct Sampler { /* private fields */ }

Draws tokens from a row of logits, carrying the sampling stream with it.

Gpt2::generate and friends sample internally; this is the same drawing logic for callers that own the loop themselves, and it owns its RNG so no caller has to name rand’s types.

let mut s = Sampler::new(1337);
let logits = vec![0.1f32, 2.0, 0.3];
let id = s.pick(&logits, Sampling::TopK { k: 2, temperature: 0.8, seed: 0 });

Sampling::TopK’s own seed field is ignored here — the stream is this sampler’s, seeded once at Sampler::new, so successive picks continue it rather than restarting it.

Implementations

impl Sampler

pub fn new(seed: u64) -> Self

pub fn pick(&mut self, logits: &[f32], sampling: Sampling) -> u32

One token id from logits. Deterministic under Sampling::Greedy; otherwise it advances this sampler’s stream.

pub fn reseed(&mut self, seed: u64)

Restart the stream. Same contract as constructing a fresh sampler.