Skip to main content

Crate llama_cpp_v3

Crate llama_cpp_v3 

Source

Re-exports§

pub use backend::Backend;

Modules§

backend
downloader

Structs§

LlamaBackend
The initialized Llama capabilities backend. Holds the DLL handle alive.
LlamaBatch
LlamaContext
Inference context attached to a model
LlamaModel
A loaded GGUF model
LlamaSampler
LlamaVocab
LoadOptions

Enums§

LlamaError