Struct ModelRouter 

pub struct ModelRouter { /* private fields */ }

Routes LLM requests to the correct provider based on model prefix. claude-* → Anthropic gpt-, o1, o3* → OpenAI ollama:* → Ollama zai:, glm- → ZAI mock* → Mock

Implementations

impl ModelRouter

pub fn new() -> Self

pub fn with_provider(self, provider: Arc<dyn LlmProvider>) -> Self

pub fn add_provider(&mut self, provider: Arc<dyn LlmProvider>)

Trait Implementations

impl Default for ModelRouter

fn default() -> Self

Returns the “default value” for a type.

impl LlmProvider for ModelRouter

fn generate<'life0, 'async_trait>( &'life0 self, req: LlmRequest, ) -> Pin<Box<dyn Future<Output = Result<LlmResponse>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Generate a response (non-streaming)

fn name(&self) -> &str

Provider name for routing/logging

fn supports_model(&self, model: &str) -> bool

Models supported by this provider (prefix matching)