Skip to main content

create_llg_sampler

llama_cpp_bindings::llguidance_sampler

Function create_llg_sampler 

Source 
pub fn create_llg_sampler(
    model: &LlamaModel,
    grammar_kind: &str,
    grammar_data: &str,
) -> Result<LlamaSampler, GrammarError>
Expand description

ยงErrors

Returns GrammarError if the parser factory, grammar, or parser cannot be created.