Expand description
The identity and bid foundation types: what Identification::identify
produces about a model (IdentifiedModel) and what a runtime adapter
offers to serve it (RuntimeBid). The identify orchestration and the bid
auction build on these.
Structs§
- Identified
Model - What identification determined about a model: its format and the modality, capabilities, execution shape, parameter schema, and context/template facts implied by it.
- Runtime
Bid - A runtime adapter’s offer to serve a model: how well it runs (the tier), a ranking preference (lower wins), and the other runtimes that could also serve it (recorded as alternatives on the resolved record).
Functions§
- identify
- Identify what a
recordis from its source kind and on-disk files: a fixed profile for builtin/endpoint/ollama models, else the GGUF/GGML header, a diffusersmodel_index.json, aconfig.json+safetensors layout, or the GGUF weights inside the container when the record names a directory, which is the shape a Hugging Face cache repo has.