Skip to main content

Module hardware

Module hardware 

Source
Expand description

Hardware probes for onboarding: detects CPU/RAM/GPU and local Ollama availability, then maps those facts to a ranked list of embedding model options. Pure probing — no tool surface.

Structs§

HardwareContext
System facts gathered at onboarding time for model selection.
ModelOption
One entry in the ranked model recommendation list.

Enums§

GpuInfo
GPU vendor and VRAM info (best-effort; None means no GPU detected).

Functions§

detect_hardware_context
Probe the local system for hardware capabilities relevant to embedding model selection. All probes run in parallel with a 2-second timeout; any failure produces a safe zero/None default — never panics.
model_options_for_hardware
Pure function: derive a ranked model list from hardware facts. The first entry is always the recommended default (local:AllMiniLML6V2Q).