Struct RoutingDriver 

pub struct RoutingDriver { /* private fields */ }

Routing driver: local-first with remote fallback.

Wraps two LlmDriver implementations. The primary driver (typically RealizarDriver for sovereign inference) is tried first. On failure, the fallback (typically RemoteDriver) handles the request.

Privacy tier is the more permissive of the two drivers — if the fallback is Standard, data may leave the machine on spillover, so the routing driver reports Standard.

Implementations

impl RoutingDriver

pub fn new(primary: Box<dyn LlmDriver>, fallback: Box<dyn LlmDriver>) -> Self

Create a new routing driver with primary and fallback.

pub fn primary_only(primary: Box<dyn LlmDriver>) -> Self

Create a routing driver with primary only (no fallback).

pub fn with_strategy(self, strategy: RoutingStrategy) -> Self

Set the routing strategy.

pub fn metrics(&self) -> &RoutingMetrics

Get routing metrics.

Trait Implementations

impl LlmDriver for RoutingDriver

fn complete<'life0, 'async_trait>( &'life0 self, request: CompletionRequest, ) -> Pin<Box<dyn Future<Output = Result<CompletionResponse, AgentError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Non-streaming completion.

fn context_window(&self) -> usize

Maximum context window in tokens.

fn privacy_tier(&self) -> PrivacyTier

Privacy tier this driver operates at.

fn stream<'life0, 'async_trait>( &'life0 self, request: CompletionRequest, tx: Sender<StreamEvent>, ) -> Pin<Box<dyn Future<Output = Result<CompletionResponse, AgentError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Streaming completion with channel-based events.

fn estimate_cost(&self, _usage: &TokenUsage) -> f64

Estimate cost in USD for a single completion’s token usage.