Skip to main content

Module gguf_models

Module gguf_models 

Source
Expand description

Turning a flat list of GGUF files into DiscoveredModels: loose files become one model each, shard sets become a single model keyed by their shared base (flagged as still-downloading when incomplete). Shared by the file-tree scanners (LM Studio, loose files).

Functions§

discovered_models
Build discovered models from files (each a GGUF path and its byte size). repo derives the repository label from a file’s path (e.g. a relative <org>/<model> prefix), or None. Returns the models and any per-shard-set issues (a shard set missing its first part is skipped, not emitted).
is_mmproj_name
Whether a filename looks like a multimodal projector (never the primary weight). Case-insensitive mmproj substring.