Enum ToolChoice 

pub enum ToolChoice {
    Auto,
    Required,
    None,
}

What the model is allowed to do with the supplied tools.

Variants

Auto

The model decides whether to call a tool.

Required

The model must call a tool. This is enforced by grammar, not by prompt.

None

Tools are visible to the template but must not be called.

Implementations

impl ToolChoice

pub fn parse_oaicompat(value: &str) -> Result<Self, ChatError>

Parse an OpenAI tool_choice value: "auto", "required" or "none".

Errors

Returns ChatError::Failed if llama.cpp does not recognise value.

Trait Implementations

impl Clone for ToolChoice

fn clone(&self) -> ToolChoice

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for ToolChoice

impl Debug for ToolChoice

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ToolChoice

fn default() -> ToolChoice

Returns the “default value” for a type.

impl Eq for ToolChoice

impl PartialEq for ToolChoice

fn eq(&self, other: &ToolChoice) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for ToolChoice