Expand description
Token sampling — temperature, top-p, top-k, min-p, repetition penalty.
Randomness comes from an explicit SplitMix64 PRNG carried by the
caller: reproducible with a seed, unbiased across the whole CDF
(the v1 subsec_nanos source could never pick past ~23% of it).
Structs§
- Sampler
Config - Sampling configuration.
- Split
Mix64 - SplitMix64 — tiny, fast, statistically solid for sampling.