Struct StructuredOutputFactory 

pub struct StructuredOutputFactory { /* private fields */ }

Shared, immutable tokenizer and grammar compilation state.

Implementations

impl StructuredOutputFactory

pub fn new(tokenizer: Arc<dyn Tokenizer + Send + Sync>) -> Result<Self>

Build the tokenizer trie once for this engine.

pub fn new_with_model_vocab_size( tokenizer: Arc<dyn Tokenizer + Send + Sync>, model_vocab_size: Option<usize>, ) -> Result<Self>

Build against the executor’s logits width when it is larger than the tokenizer base vocabulary (for example added EOS/control tokens).

pub fn create_processor( &self, response_format: &ResponseFormat, start: &StructuredOutputStart, max_output_tokens: usize, stop_token_ids: &HashSet<u32>, stop_text_sequences: &[String], ) -> Result<Option<StructuredOutputProcessor>>

Compile one request’s grammar while reusing the tokenizer trie.

Trait Implementations

impl Debug for StructuredOutputFactory

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.