Struct RetryMiddleware 

pub struct RetryMiddleware { /* private fields */ }

Retries transient LLM errors with exponential backoff and jitter.

• max_attempts: total attempts including the first call (minimum 1).
• initial_interval: base delay before the first retry; doubles each attempt.
• Jitter: up to 25% of the current interval, added randomly.

Implementations

impl RetryMiddleware

pub fn new(max_attempts: u32, initial_interval: Duration) -> Self

Create a retry middleware.

max_attempts is clamped to at least 1. initial_interval is the delay before the first retry; subsequent retries double the interval.

Trait Implementations

impl ProviderMiddleware for RetryMiddleware

fn wrap_complete<'life0, 'life1, 'life2, 'life3, 'async_trait>( &'life0 self, messages: &'life1 [Message], tools: &'life2 [ToolSchema], next: &'life3 dyn LlmProvider, ) -> Pin<Box<dyn Future<Output = Result<LlmResponse, PeError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait, 'life3: 'async_trait,

Wrap a completion call. Call next.complete(messages, tools).await to forward to the next layer (or the base provider).