Struct FallbackChain 

pub struct FallbackChain {
    pub models: Vec<String>,
}

Ordered fallback chain that tries models sequentially.

Fields

models: Vec<String>

Ordered list of "provider/model-id" fallback targets.

Implementations

impl FallbackChain

pub fn new(models: Vec<String>) -> FallbackChain

Create a new fallback chain.

pub async fn try_models( &self, registry: &Arc<ProviderRegistry>, context: &Context, options: Option<StreamOptions>, ) -> Result<Pin<Box<dyn Stream<Item = ProviderEvent> + Send>>, ProviderError>

Try each model in sequence using a ProviderRegistry.

pub async fn try_models_with_resolver<F>( &self, resolver: F, context: &Context, options: Option<StreamOptions>, ) -> Result<Pin<Box<dyn Stream<Item = ProviderEvent> + Send>>, ProviderError>

where F: Fn(&str) -> Option<Arc<dyn Provider>> + Sync,

Try each model using a generic resolver closure.

Trait Implementations

impl Clone for FallbackChain

fn clone(&self) -> FallbackChain

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for FallbackChain

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Default for FallbackChain

fn default() -> FallbackChain

Returns the “default value” for a type.