Struct ConstrainedSampler 

pub struct ConstrainedSampler { /* private fields */ }

Wraps a crate::sampling_advanced::SamplerChain with a TokenConstraint.

Before each sampling step the logits for disallowed tokens are masked to -1e9 so they are effectively excluded from the distribution.

Implementations

impl ConstrainedSampler

pub fn new( sampler: SamplerChain, constraint: Box<dyn TokenConstraint>, vocab_size: usize, ) -> Self

Create a new ConstrainedSampler.

pub fn sample(&mut self, logits: &mut Vec<f32>) -> u32

Sample the next token, masking logits for disallowed tokens first.

Steps:

1. Query the constraint for an allowed-token mask.
2. Set logits[i] = -1e9 for every false entry in the mask.
3. Delegate to the inner sampler chain.
4. Call constraint.advance(token).
5. Track the token in self.generated.

pub fn is_complete(&self) -> bool

Returns true if the constraint considers the current output complete.

pub fn reset(&mut self)

Reset both the inner sampler state and the constraint.

pub fn generated_text_len(&self) -> usize

Number of tokens generated so far.

pub fn constraint_name(&self) -> &str

Human-readable name of the active constraint.