Module model 

A safe wrapper around llama_model.

Re-exports

pub use crate::vocab::LlamaTokenTypeFromIntError;

pub use crate::vocab::VocabType;

Modules

params

A safe wrapper around llama_model_params.

Structs

LlamaChatMessage

A Safe wrapper around llama_chat_message

LlamaChatTemplate

A performance-friendly wrapper around LlamaModel::chat_template which is then fed into LlamaModel::apply_chat_template to convert a list of messages into an LLM prompt. Internally the template is stored as a CString to avoid round-trip conversions within the FFI.

LlamaLoraAdapter

A safe wrapper around llama_lora_adapter.

LlamaModel

A safe wrapper around llama_model.

Enums

RopeType

The RoPE type that’s used within the model.