Struct FallbackRouter 

pub struct FallbackRouter { /* private fields */ }

Router that tries providers in order and falls back on eligible errors.

Implementations

impl FallbackRouter

pub fn new(providers: Vec<Arc<dyn Provider>>) -> Result<Self>

Create a new fallback router.

Errors

Returns a routing error if no providers are supplied.

pub fn with_config( providers: Vec<Arc<dyn Provider>>, config: FallbackRouterConfig, ) -> Result<Self>

Create a new fallback router with custom configuration.

Errors

Returns a routing error if no providers are supplied.

pub fn provider_count(&self) -> usize

Return the number of configured providers.

pub async fn complete( &self, request: &CompletionRequest, ) -> Result<CompletionResponse>

Execute a completion request with fallback logic.

pub async fn stream( &self, request: &CompletionRequest, ) -> Result<Box<dyn Stream<Item = Result<CompletionChunk>> + Send + Unpin>>

Execute a streaming request with fallback logic.