Struct Llama2Template 

pub struct Llama2Template { /* private fields */ }

LLaMA 2 Template (TinyLlama, Vicuna, LLaMA 2)

Format: <s>[INST] <<SYS>>\n{system}\n<</SYS>>\n\n{user} [/INST]

Example

use aprender::text::chat_template::{ChatMessage, Llama2Template, ChatTemplateEngine};

let template = Llama2Template::new();
let messages = vec![ChatMessage::user("Hello!")];
let output = template.format_conversation(&messages).expect("format conversation should succeed");
assert!(output.contains("[INST]"));

Implementations

impl Llama2Template

pub fn new() -> Self

Create a new LLaMA 2 template

Trait Implementations

impl ChatTemplateEngine for Llama2Template

fn format_message( &self, role: &str, content: &str, ) -> Result<String, AprenderError>

Format a single message with role and content (for streaming/partial)

fn format_conversation( &self, messages: &[ChatMessage], ) -> Result<String, AprenderError>

Format a complete conversation

fn special_tokens(&self) -> &SpecialTokens

Get special tokens for this template

fn format(&self) -> TemplateFormat

Get the detected template format

fn supports_system_prompt(&self) -> bool

Check if this template supports system prompts

impl Clone for Llama2Template

fn clone(&self) -> Llama2Template

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Llama2Template

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for Llama2Template

fn default() -> Self

Returns the “default value” for a type.