Expand description
Tokenizer-aware hard constraints for structured output.
A factory owns the tokenizer trie and grammar compiler and is shared by an engine. Each request gets an independent matcher with no shared mutable grammar state.
Structs§
- Structured
Output Budget Plan - Immutable per-request output budget used when a structured grammar starts after a reasoning delimiter.
- Structured
Output Factory - Shared, immutable tokenizer and grammar compilation state.
- Structured
Output Mask Outcome - Allocation-free hot-path result of one structured-output mask operation.
- Structured
Output Processor - Per-request structured-output parser state.
- Structured
Output Progress - Terminal/debug snapshot that distinguishes activation failures from an incomplete grammar without retaining generated text.
Enums§
- Structured
Output Phase - Typed phase returned after applying a structured-output constraint.
- Structured
Output Token Class - Privacy-safe lexical class for the tail of an incomplete grammar.