Re-exports§
pub use backend::Backend;
Modules§
Structs§
- Llama
Backend - The initialized Llama capabilities backend. Holds the DLL handle alive.
- Llama
Batch - Llama
Context - Inference context attached to a model
- Llama
Model - A loaded GGUF model
- Llama
Sampler - Llama
Vocab - Load
Options