Struct RoutingProvider 

pub struct RoutingProvider { /* private fields */ }

A provider that acts as a router, delegating to other providers based on the model name. Model names must be in the format provider/model (e.g., openai/gpt-4).

Implementations

impl RoutingProvider

pub fn new(registry: ProviderRegistry) -> Self

Create a new routing provider with the given registry

Trait Implementations

impl Clone for RoutingProvider

fn clone(&self) -> RoutingProvider

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for RoutingProvider

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Provider for RoutingProvider

fn chat_completion<'life0, 'async_trait>( &'life0 self, request: ChatCompletionRequest, ) -> Pin<Box<dyn Future<Output = Result<ChatCompletionResponse, LlmError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Generate a chat completion

fn chat_completion_stream( &self, request: ChatCompletionRequest, ) -> Pin<Box<dyn Future<Output = Result<ChatCompletionStream, LlmError>> + Send + '_>>

Stream a chat completion

fn embeddings<'life0, 'async_trait>( &'life0 self, request: EmbeddingRequest, ) -> Pin<Box<dyn Future<Output = Result<EmbeddingResponse, LlmError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Generate embeddings for text

fn supported_models(&self) -> Vec<String>

Get the list of models supported by this provider

fn provider_name(&self) -> &'static str

Get the provider name

fn list_models<'life0, 'async_trait>( &'life0 self, ) -> Pin<Box<dyn Future<Output = Result<Vec<String>, LlmError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Dynamically list available models from the provider API