Struct ApplyChatTemplateArgs 

pub struct ApplyChatTemplateArgs<'a, I, R = Role, T = String>
where
    I: IntoIterator<Item = Chat<'a, R, T>>,
    R: Serialize + 'a,
    T: Serialize + 'a,
{
    pub conversations: I,
    pub tools: Option<&'a [Value]>,
    pub documents: Option<&'a [Document]>,
    pub model_id: &'a str,
    pub chat_template_id: Option<&'a str>,
    pub add_generation_prompt: Option<bool>,
    pub continue_final_message: Option<bool>,
    pub template_kwargs: Option<&'a Map<String, Value>>,
}

Inputs for rendering one or more conversations with a chat template.

Fields

conversations: I

Conversations to render.

tools: Option<&'a [Value]>

Tool definitions exposed to the template.

documents: Option<&'a [Document]>

Documents exposed to the template.

model_id: &'a str

Stable model identifier used to cache the compiled template.

chat_template_id: Option<&'a str>

Identifier of a template already registered in the environment.

add_generation_prompt: Option<bool>

Whether to ask the template to append its generation prompt.

continue_final_message: Option<bool>

Whether to trim the rendering after the final input message.

template_kwargs: Option<&'a Map<String, Value>>

Additional variables exposed to the template.

Trait Implementations

impl<'a, I, R, T> Default for ApplyChatTemplateArgs<'a, I, R, T>

where I: IntoIterator<Item = Chat<'a, R, T>> + Default, R: Serialize + 'a + Default, T: Serialize + 'a + Default,

fn default() -> ApplyChatTemplateArgs<'a, I, R, T>

Returns the “default value” for a type.