Skip to main content

Module identity

Module identity 

Source
Expand description

The identity and bid foundation types: what Identification::identify produces about a model (IdentifiedModel) and what a runtime adapter offers to serve it (RuntimeBid). The identify orchestration and the bid auction build on these.

Structs§

IdentifiedModel
What identification determined about a model: its format and the modality, capabilities, execution shape, parameter schema, and context/template facts implied by it.
RuntimeBid
A runtime adapter’s offer to serve a model: how well it runs (the tier), a ranking preference (lower wins), and the other runtimes that could also serve it (recorded as alternatives on the resolved record).

Functions§

identify
Identify what a record is from its source kind and on-disk files: a fixed profile for builtin/endpoint/ollama models, else the GGUF/GGML header, a diffusers model_index.json, a config.json+safetensors layout, or the GGUF weights inside the container when the record names a directory, which is the shape a Hugging Face cache repo has.