Struct StructuredOutputProcessor 

pub struct StructuredOutputProcessor { /* private fields */ }

Per-request structured-output parser state.

Implementations

impl StructuredOutputProcessor

pub fn mask_logits( &self, logits: &mut [f32], generated: &[TokenId], ) -> Result<()>

Consume newly generated tokens and hard-mask every illegal next token. Waiting-for-reasoning mode leaves normal logits untouched until the typed delimiter has been observed.

pub fn mask_logits_with_terminals( &self, logits: &mut [f32], generated: &[TokenId], terminal_token_ids: &HashSet<u32>, hidden_control_token_ids: &HashSet<u32>, ) -> Result<StructuredOutputMaskOutcome>

Apply the grammar mask while allowing engine-resolved stop tokens once the grammar accepts. Some model templates use an end-of-turn token that is not the tokenizer’s primary EOS, so it cannot be represented by the grammar parser’s EOS set alone.

pub fn is_accepting(&self, generated: &[TokenId]) -> Result<bool>

True only when reasoning has closed and the grammar accepts the full generated structured value.

pub fn is_accepting_with_terminals( &self, generated: &[TokenId], terminal_token_ids: &HashSet<u32>, ) -> Result<bool>

Completion check that treats an engine-resolved terminal sampled after grammar acceptance as framing rather than part of the JSON value.

pub fn progress_with_terminals( &self, generated: &[TokenId], terminal_token_ids: &HashSet<u32>, ) -> Result<StructuredOutputProgress>

Inspect the typed activation/grammar state after consuming generated.

pub fn reset(&self) -> Result<()>

Trait Implementations

impl Debug for StructuredOutputProcessor

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.