Skip to main content

Module runtime_manager

Module runtime_manager 

Source
Expand description

Runtime Manager

Orchestrates model runtime selection, initialization, and lifecycle management. Automatically selects the appropriate runtime based on model format. Lock-free implementation using ArcSwap for atomic pointer swapping.

Structsยง

RuntimeManager
Runtime Manager - manages active model runtime