Struct RegexGuidedProcessor 

pub struct RegexGuidedProcessor { /* private fields */ }

Hard-mask regex constraint processor.

Build with RegexGuidedProcessor::new(pattern, tokenizer, eos_token); use by adding as a high-priority logits processor before temperature / top-k / top-p.

Implementations

impl RegexGuidedProcessor

pub fn new( pattern: &str, tokenizer: Arc<dyn Tokenizer + Send + Sync>, eos_token: Option<TokenId>, ) -> Result<Self>

Build a guided-decoding processor for pattern. tokenizer is used to map each vocab entry to its byte representation.

pub fn reset(&self) -> Result<()>

Reset for a new generation.

pub fn can_accept(&self) -> bool

Check if the pattern can currently accept (i.e. EOS is valid here).

pub fn mask_logits(&self, logits: &mut [f32])

Apply the hard mask to logits given the current DFA state.

pub fn advance_with_tokens_public(&self, tokens: &[TokenId])

Public wrapper around advance_with_tokens for direct callers (the engine applies the mask inline rather than via LogitsProcessor::process).

Trait Implementations

impl Debug for RegexGuidedProcessor

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl LogitsProcessor for RegexGuidedProcessor

fn process(&self, ctx: &mut SamplingContext<'_>) -> Result<()>

Process logits in-place

fn name(&self) -> &str

Get processor name for debugging/logging

fn priority(&self) -> ProcessorPriority

Whether this processor should be applied before others