Struct ChatTemplate 

pub struct ChatTemplate(/* private fields */);

A compiled chat template. Cheap to clone (Arc inside) because every *Loaded struct in ferrox-server carries one and hands it to each request.

Implementations

impl ChatTemplate

pub fn from_jinja(source: &str) -> Result<Self, TemplateError>

Compiles source as Jinja2. Errors are returned, never swallowed.

pub fn builtin(b: BuiltinTemplate) -> Self

pub fn from_gguf_metadata( chat_template: Option<&str>, arch: Option<&str>, byte_tokenizer: bool, ) -> Self

The load-time entry point: what a GGUF’s metadata says.

• a non-empty tokenizer.chat_template is compiled, and a compile failure is recorded (so the load still succeeds and /v1/completions still works) but makes every chat render fail with the compiler’s message;
• no template + a real tokenizer ⇒ ChatML, matching llama.cpp --jinja’s CHATML_TEMPLATE_SRC default;
• no template + a byte/synthetic tokenizer ⇒ Plain, since there is no real vocabulary for markers to live in.

pub fn is_jinja(&self) -> bool

True when this is the checkpoint’s own compiled template.

pub fn source(&self) -> Option<&str>

The compiled Jinja source, for callers that need to inspect it.

pub fn handles_tools(&self) -> bool

Whether the template itself renders tools.

Templates that never mention tools cannot express a tool call, so a caller offering tools to such a checkpoint has to fall back to describing them in a system message (ferrox-server’s tool_preamble). This is a textual check on the template source, which is what llama.cpp’s common/chat.cpp does too (caps.supports_tools is probed by rendering, but the cheap source check is what gates it here).

pub fn describe(&self) -> String

Short human-readable identity, for the load-time log line.

pub fn render( &self, messages: &[Value], opts: &RenderOptions, ) -> Result<String, TemplateError>

Renders messages (OpenAI-shaped JSON objects) into a prompt.

Trait Implementations

impl Clone for ChatTemplate

fn clone(&self) -> ChatTemplate

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ChatTemplate

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.