Struct RetryWrapper 

pub struct RetryWrapper { /* private fields */ }

Wraps an LLM provider with retry logic.

Implementations

impl RetryWrapper

pub fn new(provider: Arc<dyn LlmProvider>) -> Self

Creates a new retry wrapper with default settings.

Default settings:

• Max attempts: 3
• Initial delay: 1 second
• Max delay: 10 seconds
• Multiplier: 2.0 (exponential backoff)

pub fn with_max_attempts(self, max_attempts: u32) -> Self

Sets the maximum number of attempts.

pub fn with_initial_delay(self, delay: Duration) -> Self

Sets the initial delay between retries.

pub fn with_max_delay(self, delay: Duration) -> Self

Sets the maximum delay between retries.

Trait Implementations

impl LlmProvider for RetryWrapper

fn complete<'life0, 'async_trait>( &'life0 self, request: CompletionRequest, ) -> Pin<Box<dyn Future<Output = Result<CompletionResponse>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Completes a prompt and returns the full response.

fn complete_streaming<'life0, 'async_trait>( &'life0 self, request: CompletionRequest, ) -> Pin<Box<dyn Future<Output = Result<CompletionStream>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Completes a prompt with streaming response.