Struct RouterEngine 

pub struct RouterEngine { /* private fields */ }

Client-side router engine that wraps the core routing engine

Implementations

impl RouterEngine

pub async fn new() -> Self

Create a new router engine with default configuration and all built-in strategies

pub async fn with_limits(limits: GlobalLimits) -> Self

Create a new router engine with custom global limits

pub async fn load_deployments(&self, deployments: Vec<Deployment>)

Load deployments into the routing pool

pub async fn rebuild_pool(&self, deployments: Vec<Deployment>)

Rebuild the deployment pool with a fresh set

pub async fn select_deployment( &self, request: &ChatRequest, ) -> Result<RoutingResult, RoutingError>

Select a deployment for a request using routing strategies

pub async fn record_success( &self, deployment_id: &str, latency_ms: f64, tokens: u64, )

Record a successful request for metrics

pub async fn record_failure(&self, deployment_id: &str)

Record a failed request for metrics

pub fn inner(&self) -> &Arc<HyperInferRouterEngine>

Get the inner router engine (for advanced use)