Struct SamplerChain 

pub struct SamplerChain { /* private fields */ }

A composable pipeline of SamplerStages followed by a final selection step.

Implementations

impl SamplerChain

pub fn new() -> Self

Create an empty chain (no stages, default seed).

pub fn with_seed(self, seed: u64) -> Self

Set the RNG seed for the final selection step.

pub fn push(self, stage: impl SamplerStage + 'static) -> Self

Append a stage to the pipeline. Returns self for chaining.

pub fn sample(&self, logits: &[f32], recent_tokens: &[u32]) -> u32

Run all stages on a copy of the logits and select a token.

The original logit slice is not modified.

pub fn len(&self) -> usize

Return the number of stages in the chain.

pub fn is_empty(&self) -> bool

Check if the chain is empty.

pub fn stage_names(&self) -> Vec<&'static str>

List the names of all stages in order.

pub fn from_config(config: &SamplerConfig) -> Self

Build a chain from a SamplerConfig, replicating the standard pipeline.

Pipeline order: logit-bias → repetition penalty → DRY → XTC → TypicalP → TopA → Eta → temperature → top-K → min-P → top-P.

Logit-bias must come first so that bans and boosts are visible to all downstream filtering stages. The five advanced stages are inserted after repetition penalty (they work on logit-scale values) but before temperature scaling (so they see the pre-temperature distribution shape).

Trait Implementations

impl Default for SamplerChain

fn default() -> Self

Returns the “default value” for a type.