Module model 

A safe wrapper around llama_model.

Modules

params

A safe wrapper around llama_model_params.

Structs

LlamaChatMessage

A Safe wrapper around llama_chat_message

LlamaChatTemplate

A performance-friendly wrapper around LlamaModel::chat_template which is then fed into LlamaModel::apply_chat_template to convert a list of messages into an LLM prompt. Internally the template is stored as a CString to avoid round-trip conversions within the FFI.

LlamaLoraAdapter

A safe wrapper around llama_lora_adapter.

LlamaModel

A safe wrapper around llama_model.

Enums

AddBos

How to determine if we should prepend a bos token to tokens

LlamaTokenTypeFromIntError

There was an error converting a llama_vocab_type to a VocabType.

RopeType

The Rope type that’s used within the model.

Special

How to determine if we should tokenize special tokens

VocabType

a rusty equivalent of llama_vocab_type