Enum ChatTemplate 

pub enum ChatTemplate {
    ChatML,
    Llama3,
    Qwen,
    Raw,
}

Chat template format.

Variants

ChatML

SmolLM/Llama-style: <|im_start|>role\ncontent<|im_end|>

Llama3

Llama 3 style: <|start_header_id|>role<|end_header_id|>\n\ncontent<|eot_id|>

Qwen

Qwen style (same as ChatML)

Raw

Raw: just concatenate messages with no special formatting

Implementations

impl ChatTemplate

pub fn from_architecture(arch: &str) -> Self

Detect the appropriate template from a model architecture name.

pub fn format(&self, messages: &[ChatMessage]) -> String

Format a list of messages into a prompt string.

pub fn format_prompt(&self, prompt: &str) -> String

Format a single user prompt as a chat conversation.

pub fn format_with_system(&self, system: &str, prompt: &str) -> String

Format a single user prompt with a system message.

Trait Implementations

impl Clone for ChatTemplate

fn clone(&self) -> ChatTemplate

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ChatTemplate

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for ChatTemplate

fn eq(&self, other: &ChatTemplate) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for ChatTemplate

impl StructuralPartialEq for ChatTemplate