Expand description
A safe wrapper around llama_model.
Modules§
- params
- A safe wrapper around
llama_model_params.
Structs§
- Llama
Chat Message - A Safe wrapper around
llama_chat_message - Llama
Chat Template - A performance-friendly wrapper around LlamaModel::chat_template which is then fed into LlamaModel::apply_chat_template to convert a list of messages into an LLM prompt. Internally the template is stored as a CString to avoid round-trip conversions within the FFI.
- Llama
Lora Adapter - A safe wrapper around
llama_lora_adapter. - Llama
Model - A safe wrapper around
llama_model.
Enums§
- AddBos
- How to determine if we should prepend a bos token to tokens
- Llama
Token Type From IntError - There was an error converting a
llama_vocab_typeto aVocabType. - Rope
Type - The Rope type that’s used within the model.
- Special
- How to determine if we should tokenize special tokens
- Vocab
Type - a rusty equivalent of
llama_vocab_type