Expand description
Router - Intelligent node selection for inference requests
Combines catalog, health, and policy data to select the optimal node for each request.
Structsยง
- Route
Decision - Final routing decision with reasoning
- Router
- The main router implementation
- Router
Builder - Builder for creating routers with custom configuration
- Router
Config - Configuration for the router