Skip to main content

VocabBytes

Type Alias VocabBytes 

Source
pub type VocabBytes = Arc<Vec<(u32, Vec<u8>)>>;
Expand description

Vocabulary byte table: maps token ID to its UTF-8 byte sequence.

Used for grammar-constrained sampling. Wrapped in Arc so it can be cheaply shared between AppState and individual SamplerConfig instances.

Aliased Typeยง

pub struct VocabBytes { /* private fields */ }