Struct MultinomialSampler 

pub struct MultinomialSampler;

Multinomial sampler for probabilistic sampling

Trait Implementations

impl Sampler for MultinomialSampler

fn sample(&self, logits: &[f32], rng: &mut dyn RngCore) -> Result<TokenId>

Sample next token from logits

fn name(&self) -> &str

Get sampler name

fn is_deterministic(&self) -> bool

Whether this sampler is deterministic

fn sample_with_context( &self, ctx: &SamplingContext<'_>, rng: &mut dyn RngCore, ) -> Result<TokenId>

Sample with additional context (default implementation ignores context)