Struct ChatTemplate 

pub struct ChatTemplate { /* private fields */ }

Chat template renderer using MiniJinja

Implementations

impl ChatTemplate

pub fn new( template: impl Into<String>, bos_token: impl Into<String>, eos_token: impl Into<String>, ) -> Result<Self, ChatTemplateError>

Create from a Jinja template string

pub fn from_tokenizer_config( path: impl AsRef<Path>, ) -> Result<Self, ChatTemplateError>

Load chat template from a tokenizer_config.json file

pub fn from_tokenizer_config_str(json: &str) -> Result<Self, ChatTemplateError>

Load chat template from tokenizer_config.json content

pub fn chatml() -> Self

ChatML template used by SmolLM, Qwen, and many other models

pub fn chatml_with_thinking() -> Self

ChatML template with thinking/reasoning support

pub fn llama2() -> Self

Llama 2 chat template

pub fn llama3() -> Self

Llama 3 / 3.1 chat template

pub fn mistral() -> Self

Mistral Instruct template

pub fn gemma() -> Self

Gemma template

pub fn apply( &self, messages: &[Message], options: &ChatTemplateOptions, ) -> Result<String, ChatTemplateError>

Apply the chat template to messages

pub fn apply_for_generation( &self, messages: &[Message], ) -> Result<String, ChatTemplateError>

Convenience method: apply with add_generation_prompt=true