Skip to main content

Crate ferrite_model

Crate ferrite_model 

Source
Expand description

GGUF parsing, model configuration, and tokenizer support for Ferrite.

The crate validates GGUF v3 structure before exposing tensor byte ranges, converts supported architecture metadata into typed configuration, and provides atomic and BPE tokenization from GGUF tokenizer metadata.

Modulesยง

gguf
Validated GGUF v3 metadata and tensor layout parsing.
model_file
Read-only model-file mapping for shared GGUF tensor storage. Shared read-only model-file mapping for zero-copy tensor storage.
tokenizer
Tokenization backed by metadata embedded in a parsed GGUF file.