Skip to main content

engine_system

Function engine_system 

Source
pub async fn engine_system(
    configuration: &Configuration,
) -> Result<Value, Error<EngineSystemError>>
Expand description

System reads the engine host’s inventory: OS, CPU, memory, every accelerator device with its VRAM and compute capability, and the build’s capabilities (CUDA/Metal/flash-attention) — the real hardware under the serving runtime, relayed verbatim.