Struct FallbackProvider 

pub struct FallbackProvider { /* private fields */ }

Wraps a primary and secondary LlmProvider. On transient failure from the primary, automatically tries the secondary.

Implements LlmProvider itself, so it can be used anywhere a provider is expected (including inside a MiddlewareStack).

Implementations

impl FallbackProvider

pub fn new(primary: impl LlmProvider, secondary: impl LlmProvider) -> Self

Create a fallback provider with a primary and secondary.

Trait Implementations

impl LlmProvider for FallbackProvider

fn complete( &self, messages: &[Message], tools: &[ToolSchema], ) -> Pin<Box<dyn Future<Output = Result<LlmResponse, PeError>> + Send + '_>>

Non-streaming completion. Returns the full response.

fn stream(&self, messages: &[Message], tools: &[ToolSchema]) -> StreamFuture<'_>

Streaming completion. Yields tokens (and tool call deltas) as they arrive.

fn embed( &self, text: &str, ) -> Pin<Box<dyn Future<Output = Result<Vec<f32>, PeError>> + Send + '_>>

Embed text into a vector. Used for semantic routing and memory search.

fn provider_name(&self) -> &'static str

Human-readable provider name for logging (“openai”, “anthropic”, “mock”).