Struct ChatTemplate 

pub struct ChatTemplate { /* private fields */ }

Compiled Jinja chat template + BOS/EOS strings.

Implementations

impl ChatTemplate

pub fn from_source(src: impl Into<String>) -> Result<Self>

Compile a chat template from a raw Jinja string.

pub fn with_tokens(self, bos: Option<String>, eos: Option<String>) -> Self

Override BOS/EOS strings (passed to the template as bos_token / eos_token Jinja variables).

pub fn from_gguf(path: &Path) -> Result<Self>

Load template + BOS/EOS from a GGUF file. Reads tokenizer.chat_template first, then tokenizer.ggml.chat_template.

pub fn from_gguf_file(raw: &GgufFile) -> Result<Self>

Same as from_gguf, but reuses an already-parsed file.

pub fn source_text(&self) -> &str

pub fn source_kind(&self) -> &ChatTemplateSource

pub fn bos_token(&self) -> Option<&str>

pub fn eos_token(&self) -> Option<&str>

pub fn render( &self, messages: &[ChatMessage], add_generation_prompt: bool, ) -> Result<String>

Render the template with the given messages.

The template sees Jinja variables: messages (list of {role, content} maps), add_generation_prompt (bool), and bos_token / eos_token strings (empty if unknown).