Struct ModelRetry 

pub struct ModelRetry { /* private fields */ }

Retry the underlying LLM call when it fails with a retryable CognisError (rate-limited, network, timeout, transient provider error).

Implementations

impl ModelRetry

pub fn new(max_attempts: u32) -> Self

Build with default backoff: 100ms initial, 2x multiplier, 30s cap.

pub fn with_initial_delay(self, d: Duration) -> Self

Override the initial delay.

pub fn with_multiplier(self, m: f64) -> Self

Override the backoff multiplier.

pub fn with_max_delay(self, d: Duration) -> Self

Override the cap on per-attempt delay.

Trait Implementations

impl Middleware for ModelRetry

fn call<'life0, 'async_trait>( &'life0 self, ctx: MiddlewareCtx, next: Arc<dyn Next>, ) -> Pin<Box<dyn Future<Output = Result<ChatResponse>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Wrap a call. Implementations typically:

fn name(&self) -> &str

Friendly name for telemetry / debugging.