Struct SamplerChain 

pub struct SamplerChain { /* private fields */ }

Builder for a sampler chain.

Convenience wrapper around LlamaSampler::chain with a fluent API.

Example

use llama_crab::sampling::SamplerChain;
let chain = SamplerChain::new()
    .temp(0.8)
    .top_p(0.95, 1)
    .build();

Implementations

impl SamplerChain

pub const fn new() -> Self

Construct a new empty chain.

pub const fn with_no_perf(self, yes: bool) -> Self

Disable performance counters in the chain.

pub fn temp(self, t: f32) -> Self

Add a temperature stage.

pub fn top_k(self, k: i32) -> Self

Add a top-K stage.

pub fn top_p(self, p: f32, min_keep: usize) -> Self

Add a top-P stage.

pub fn min_p(self, p: f32, min_keep: usize) -> Self

Add a min-P stage.

pub fn penalties( self, last_n: i32, repeat: f32, freq: f32, present: f32, ) -> Self

Add a penalties stage.

pub fn greedy(self) -> Self

Add a greedy sampler.

pub fn build(self) -> Option<LlamaSampler>

Consume the chain and return a single LlamaSampler.

Trait Implementations

impl Debug for SamplerChain

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SamplerChain

fn default() -> SamplerChain

Returns the “default value” for a type.