Crate gguf_llms

Crate gguf_llms 

Source
Expand description

GGUF Interface Library - Provides functionality for parsing GGUF files

Re-exports§

pub use config::extract_model_config;
pub use metadata::GGUF_MAGIC;
pub use metadata::GgufError;
pub use metadata::GgufHeader;
pub use metadata::GgufReader;
pub use metadata::Result;
pub use metadata::TensorType;
pub use metadata::Value;
pub use metadata::ValueType;
pub use model::Model;
pub use model::ModelBuilder;
pub use model::ModelConfig;
pub use tensors::Tensor;
pub use tensors::TensorInfo;
pub use tensors::TensorLoader;

Modules§

config
Configuration extraction from GGUF metadata
metadata
model
Model layer organization and tensor grouping
tensors
GGUF tensor loading functionality