Skip to main content

Module model

Module model 

Source
Expand description

Safe wrapper around llama_model (LlamaModel).

Re-exports§

pub use params::LlamaModelParams;

Modules§

chat
Chat templates (llama_chat_apply_template).
lora
LoRA adapters (llama_lora_adapter_*).
meta
Model metadata + dimension accessors.
params
Model loading parameters (LlamaModelParams) over ik’s llama_model_params.

Structs§

LlamaModel
A loaded ik_llama.cpp model.

Enums§

AddBos
Whether to prepend a BOS (beginning-of-sequence) token when tokenizing.