Struct ModelRouter 

pub struct ModelRouter { /* private fields */ }

Selects a model Adapter by a stable provider ID.

Implementations

impl ModelRouter

pub fn new(id: impl Into<String>, provider: Arc<dyn Model>) -> Self

Creates a router with its first provider.

pub fn register( &mut self, id: impl Into<String>, provider: Arc<dyn Model>, ) -> Result<()>

Registers another provider.

pub fn choices( &self, ) -> impl DoubleEndedIterator<Item = &ModelChoice> + ExactSizeIterator + Clone

Returns the selectable routes in frontend display order.

pub fn resolve_choice( &self, route: &str, reasoning_effort: Option<&str>, ) -> Result<&ModelChoice>

Resolves one route and optional reasoning effort through the model catalog.

pub fn configure_choice(&mut self, choice: ModelChoice) -> Result<()>

Replaces display metadata for one registered route.

pub fn default_provider(&self) -> &str

Returns the default provider ID.

pub async fn respond( &self, provider: &str, request: ModelRequest<'_>, events: ModelEventSink, ) -> Result<ModelOutput>

Streams one response through the selected provider.

pub fn compaction_endpoint(&self, provider: &str) -> Result<bool>

Reports whether one route has a native compaction endpoint.

pub fn supports_image_input(&self, provider: &str) -> Result<bool>

Reports whether one route accepts native image input.

pub fn tool_discovery(&self, provider: &str) -> Result<ToolDiscoveryMode>

Reports deferred-tool cache behavior for one route.

pub fn prompt_cache_capability( &self, provider: &str, ) -> Result<PromptCacheCapability>

Reports prompt-cache support for one route.

pub fn pricing(&self, provider: &str) -> Result<Option<ModelPricing>>

Returns provider-owned pricing for one route when it is known.

pub fn estimated_cost_microusd( &self, provider: &str, usage: &TokenUsage, ) -> Result<Option<u64>>

Estimates one completed request from provider-owned rates.

pub async fn compact( &self, provider: &str, request: CompactRequest<'_>, ) -> Result<CompactOutput>

Compacts context through the selected provider.