Struct ChatTemplates 

pub struct ChatTemplates { /* private fields */ }

The chat templates a model ships, ready to apply.

Wraps common_chat_templates, which owns parsed Jinja programs — building it is not free, so hold one per model rather than one per request.

Implementations

impl ChatTemplates

pub fn from_model( model: &LlamaModel, template_override: Option<&str>, ) -> Result<Self, ChatError>

Build the template set for model.

Pass None for template_override to use whatever the model ships, or Jinja source to override it. Overriding is what lets you reach a model’s tool_use variant — fetch it with LlamaModel::chat_template and hand it back here.

Errors

Returns ChatError::Init if the model has no usable template or the override does not parse.

pub fn source(&self, variant: Option<&str>) -> Result<String, ChatError>

Where the active template came from, e.g. "model" or a builtin name.

Errors

Returns ChatError::Failed if llama.cpp could not report a source.

pub fn was_explicit(&self) -> bool

Whether the caller supplied the template rather than the model.

pub fn supports_enable_thinking(&self) -> bool

Whether this template understands enable_thinking.

pub fn caps_json(&self) -> Result<String, ChatError>

Template capabilities as a JSON object of name -> bool.

This is what upstream’s server reports on /props; it tells you whether the template can handle tools, parallel calls, a system role, and so on before you send a request it cannot render.

Errors

Returns ChatError::Failed if llama.cpp could not report caps.

pub fn apply(&self, params: &ChatApplyParams) -> Result<ChatParams, ChatError>

Render messages and tools into a prompt plus its sampling constraints.

Errors

Returns ChatError::BadJson for malformed messages/tools JSON, or ChatError::Failed if the template cannot render the request.

Trait Implementations

impl Debug for ChatTemplates

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Drop for ChatTemplates

fn drop(&mut self)

Executes the destructor for this type.

fn pin_drop(self: Pin<&mut Self>)

🔬This is a nightly-only experimental API. (pin_ergonomics)

Execute the destructor for this type, but different to Drop::drop, it requires self to be pinned.

impl Send for ChatTemplates

impl Sync for ChatTemplates