Struct FallbackProvider 

pub struct FallbackProvider { /* private fields */ }

Tries providers in order, advancing to the next on a retryable failure.

Non-retryable errors (invalid request, auth, budget) short-circuit — there is no point trying the next provider if the request itself is malformed.

Implementations

impl FallbackProvider

pub fn new(providers: Vec<Arc<dyn LlmProvider>>) -> FallbackProvider

Build a chain from an ordered list of providers (primary first).

Trait Implementations

impl LlmProvider for FallbackProvider

fn chat<'life0, 'async_trait>( &'life0 self, req: ChatRequest, ) -> Pin<Box<dyn Future<Output = Result<ChatResponse, LlmError>> + Send + 'async_trait>>

where 'life0: 'async_trait, FallbackProvider: 'async_trait,

Single-shot chat completion.

fn chat_stream<'life0, 'async_trait>( &'life0 self, req: ChatRequest, ) -> Pin<Box<dyn Future<Output = Result<Pin<Box<dyn Stream<Item = Result<StreamDelta, LlmError>> + Send>>, LlmError>> + Send + 'async_trait>>

where 'life0: 'async_trait, FallbackProvider: 'async_trait,

Streaming chat completion.

fn embed<'life0, 'async_trait>( &'life0 self, req: EmbedRequest, ) -> Pin<Box<dyn Future<Output = Result<EmbedResponse, LlmError>> + Send + 'async_trait>>

where 'life0: 'async_trait, FallbackProvider: 'async_trait,

Generate embeddings.

fn name(&self) -> &'static str

Provider name (“openai” | “anthropic” | “ollama”).

fn model(&self) -> &str

Active default model slug.

fn estimate_cost(&self, req: &ChatRequest) -> Option<CostEstimate>

Pre-flight cost estimate (no network call). None if unknown.