Struct SamplerChain 

pub struct SamplerChain { /* private fields */ }

An ordered set of sampling stages with reusable candidate storage.

Implementations

impl SamplerChain

pub const fn new() -> Self

Creates an empty chain.

pub fn push(self, sampler: impl Sampler + 'static) -> Self

Appends one concrete stage and returns the chain.

pub fn push_dyn(&mut self, sampler: Box<dyn Sampler>)

Appends a boxed stage.

pub fn llama_default(config: ChainConfig) -> Self

Builds the standard stage order from config.

pub fn sample( &mut self, logits: &mut [f32], history: &[u32], rng: &mut dyn Rng, ) -> Result<u32, Error>

Loads logits, runs every stage, and returns the selected token.

pub fn candidates(&self) -> &Candidates

Returns the candidate set left by the most recent sample call.

pub fn reset(&mut self)

Clears selection and per-sequence sampler state.

Trait Implementations

impl Debug for SamplerChain

fn fmt(&self, formatter: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SamplerChain

fn default() -> Self

Returns the “default value” for a type.