Struct JsonModeProcessor 

pub struct JsonModeProcessor { /* private fields */ }

JSON mode logits processor.

Biases logits to encourage valid JSON output by boosting structural tokens and penalizing tokens that would break JSON syntax at the current state.

Uses token ID heuristics (ASCII-range tokens for {, }, ", etc.) which works with most tokenizers where single-character punctuation maps to predictable token IDs.

Implementations

impl JsonModeProcessor

pub fn new() -> Self

pub fn reset(&self)

Reset state for a new generation.

pub fn current_state(&self) -> JsonState

Get current state (for testing).

pub fn apply_biases(&self, logits: &mut [f32], generated_text: &str)

Apply structural biases based on the generated text so far.

Examines the last generated token’s text to update state, then biases logits for the next step.

Trait Implementations

impl Debug for JsonModeProcessor

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for JsonModeProcessor

fn default() -> Self

Returns the “default value” for a type.

impl LogitsProcessor for JsonModeProcessor

fn process(&self, ctx: &mut SamplingContext<'_>) -> Result<()>

Process logits in-place

fn name(&self) -> &str

Get processor name for debugging/logging

fn priority(&self) -> ProcessorPriority

Whether this processor should be applied before others