Trait Sampler 

pub trait Sampler {
    // Required methods
    fn init(&mut self, model_tokens: &[u32]);
    fn transform(&self, output: &mut [f32]);
    fn sample(&mut self, probs: &[f32]) -> u32;
}

Required Methods

fn init(&mut self, model_tokens: &[u32])

Initialize the sampler state.

fn transform(&self, output: &mut [f32])

Update the raw model output.

fn sample(&mut self, probs: &[f32]) -> u32

Select one token from the distribution, and also update the state.

Implementors

impl Sampler for MirostatSampler

impl Sampler for NucleusSampler

impl Sampler for TypicalSampler