Struct GgufLoader 

pub struct GgufLoader;

Parses GGUF (llama.cpp/ggml) model files. See the module docs for the format and the dimension-order convention this loader corrects for.

Trait Implementations

impl ModelLoader for GgufLoader

fn format_name(&self) -> &'static str

A short, lowercase name for the format this loader parses — always one of the format strings this loader’s errors carry.

fn probe(&self, bytes: &[u8]) -> bool

Cheap, non-destructive sniff: does bytes (the start of the file) look like this loader’s format? Used by load_model to pick a loader by content rather than by file extension.

fn load(&self, path: &Path) -> Result<LoadedModel>

Parses the file at path into a LoadedModel.