pub type VocabBytes = Arc<Vec<(u32, Vec<u8>)>>;Expand description
Vocabulary byte table: maps token ID to its UTF-8 byte sequence.
Used for grammar-constrained sampling. Wrapped in Arc so it can be
cheaply shared between AppState and individual SamplerConfig instances.
Aliased Typeยง
pub struct VocabBytes { /* private fields */ }