Struct SamplerChain 

pub struct SamplerChain { /* private fields */ }

Composable sampling pipeline.

Steps are applied sequentially to the logit vector. The first Greedy or Mirostat2 step that yields a token terminates the pipeline. All other steps modify the logit/probability vector in place.

Example

use oxibonsai_runtime::sampling_advanced::{SamplerChain, SamplerStep};

let mut chain = SamplerChain::default_chat(42);
let mut logits = vec![1.0_f32, 5.0, 2.0, 3.0];
let token = chain.sample(&mut logits);
assert!(token < 4);

Implementations

impl SamplerChain

pub fn new(seed: u64) -> Self

Create an empty chain with the given RNG seed.

pub fn add(self, step: SamplerStep) -> Self

Append a step to the chain (builder pattern).

pub fn sample(&mut self, logits: &mut Vec<f32>) -> usize

Sample from the given logits, applying all steps in order.

logits is consumed/mutated during processing.

pub fn greedy() -> Self

Greedy decoding — always picks the token with the highest logit.

pub fn default_chat(seed: u64) -> Self

Default chat preset: temperature(0.7) → top_p(0.9) → min_p(0.05).

pub fn creative(seed: u64) -> Self

Creative preset: temperature(1.0) → mirostat_v2(tau=5.0, eta=0.1).

pub fn precise(seed: u64) -> Self

Precise preset: temperature(0.3) → top_k(40) → top_p(0.9).

Trait Implementations

impl Clone for SamplerChain

fn clone(&self) -> SamplerChain

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SamplerChain

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.