pub unsafe extern "C" fn llama_sampler_init_grammar_lazy(
vocab: *const llama_vocab,
grammar_str: *const c_char,
grammar_root: *const c_char,
trigger_words: *mut *const c_char,
num_trigger_words: usize,
trigger_tokens: *const llama_token,
num_trigger_tokens: usize,
) -> *mut llama_sampler
Expand description
@details Lazy grammar sampler, introduced in https://github.com/ggerganov/llama.cpp/pull/9639 @param trigger_words A list of words that will trigger the grammar sampler. This may be updated to a loose regex syntax (w/ ^) in a near future. @param trigger_tokens A list of tokens that will trigger the grammar sampler.