Skip to main content

auto_chat_template

Function auto_chat_template 

Source
pub fn auto_chat_template(path: &Path) -> Result<ChatTemplate>
Expand description

Convenience for the M3 auto-dispatch family: load the chat template

  • BOS/EOS strings directly from a GGUF path.

Alias for ChatTemplate::from_gguf. Use rlx_models::run::auto_chat_template(path) next to rlx_models::run::auto_runner(path).