Expand description
GGUF parsing, model configuration, and tokenizer support for Ferrite.
The crate validates GGUF v3 structure before exposing tensor byte ranges, converts supported architecture metadata into typed configuration, and provides atomic and BPE tokenization from GGUF tokenizer metadata.
Modulesยง
- gguf
- Validated GGUF v3 metadata and tensor layout parsing.
- model_
file - Read-only model-file mapping for shared GGUF tensor storage. Shared read-only model-file mapping for zero-copy tensor storage.
- tokenizer
- Tokenization backed by metadata embedded in a parsed GGUF file.