Enum ToolCallGrammar 

pub enum ToolCallGrammar {
    Llama3,
    Qwen,
    Mistral,
    Custom {
        open: String,
        close: String,
    },
}

Specifies the delimiter syntax used by a given model for tool calls.

Choose the variant that matches your deployed model:

• Llama3 for LLaMA 3 models.
• Qwen for Qwen / Qwen2 models.
• Mistral for Mistral / Mixtral function-calling models.
• Custom for any other format.

Variants

Llama3

LLaMA 3 tool-call format: <|tool_call|>...</|tool_call|>.

Qwen

Qwen / Qwen2 format: <tool_call>...</tool_call>.

Mistral

Mistral function-calling format: [TOOL_CALLS][...].

Custom

User-supplied open/close delimiter pair.

Fields

open: String

Opening delimiter (e.g. "<tool_call>").

close: String

Closing delimiter (e.g. "</tool_call>").

Implementations

impl ToolCallGrammar

pub fn open_delimiter(&self) -> &str

Return the opening delimiter for this grammar variant.

pub fn close_delimiter(&self) -> &str

Return the closing delimiter for this grammar variant.

Trait Implementations

impl Clone for ToolCallGrammar

fn clone(&self) -> ToolCallGrammar

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ToolCallGrammar

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.