Struct SamplingPipeline 

pub struct SamplingPipeline { /* private fields */ }

Sampling pipeline that combines config and execution logic.

This struct holds a SamplingConfig and provides a convenient interface for sampling tokens with context.

Implementations

impl SamplingPipeline

pub fn new(params: &SamplingParams) -> Self

Create new pipeline from parameters

pub fn config(&self) -> &SamplingConfig

Get reference to sampling config

pub fn sample_next( &self, step: usize, logits: &mut [f32], previous_tokens: &[TokenId], token_frequencies: &HashMap<TokenId, usize>, sampling_params: &SamplingParams, rng: &mut dyn RngCore, ) -> Result<TokenId>

Sample next token with full context

Arguments

• step - Current generation step (0-based)
• logits - Mutable logits array to process
• previous_tokens - Previously generated tokens
• token_frequencies - Token frequency map for penalties
• sampling_params - Sampling parameters for this step
• rng - Random number generator

pub fn sample_simple( &self, logits: &mut [f32], rng: &mut dyn RngCore, ) -> Result<TokenId>

Simple sampling without context (uses default params)