Struct ModelFallback 

pub struct ModelFallback { /* private fields */ }

An ordered sequence of fallback models to attempt when the primary model (and its retries) are exhausted.

The agent tries each model in order, applying the configured RetryStrategy independently for each model. When all fallback models are also exhausted the error propagates normally.

Example

use swink_agent::{ModelFallback, ModelSpec};

let fallback = ModelFallback::new(vec![
    (ModelSpec::new("openai", "gpt-4o-mini"), make_stream_fn()),
    (ModelSpec::new("anthropic", "claude-3-haiku-20240307"), make_stream_fn()),
]);

Implementations

impl ModelFallback

pub fn new(models: Vec<(ModelSpec, Arc<dyn StreamFn>)>) -> Self

Create a new fallback chain from an ordered list of model/stream pairs.

pub fn models(&self) -> &[(ModelSpec, Arc<dyn StreamFn>)]

Returns the fallback models in order.

pub fn is_empty(&self) -> bool

Returns true if the fallback chain is empty.

pub fn len(&self) -> usize

Returns the number of fallback models.

Trait Implementations

impl Clone for ModelFallback

fn clone(&self) -> ModelFallback

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ModelFallback

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.