Expand description
Pure Rust llguidance sampler for constrained decoding.
Implements a custom llama_sampler using the llguidance and toktrie Rust crates
to enforce grammar constraints (JSON schema, regex, Lark, etc.) during token sampling.
Functionsยง
- create_
llg_ sampler - Create an llguidance-based constrained decoding sampler.