Skip to main content

RetryProvider

Struct RetryProvider 

Source
pub struct RetryProvider {
    pub max_retries: u32,
    pub base_delay: Duration,
    /* private fields */
}
Expand description

Opt-in retry wrapper for any LlmProvider.

Wraps an inner provider and retries transient errors (timeout, network, HTTP 500/429) up to max_retries times with exponential backoff starting from base_delay. Non-retryable errors (auth, process, nested session, other HTTP status codes) are returned immediately.

Implements LlmProvider itself, making it transparent to consumers.

Fields§

§max_retries: u32

Maximum number of retry attempts after the first failure.

§base_delay: Duration

Delay between retry attempts.

Implementations§

Source§

impl RetryProvider

Source

pub fn new(inner: Arc<dyn LlmProvider>) -> Self

Creates a new RetryProvider with default settings (3 retries, 1s delay).

§Parameters
  • inner: The provider to wrap with retry logic.
Source

pub fn with_config( inner: Arc<dyn LlmProvider>, max_retries: u32, base_delay: Duration, ) -> Self

Creates a new RetryProvider with custom retry settings.

§Parameters
  • inner: The provider to wrap with retry logic.
  • max_retries: Maximum retry attempts after the initial failure.
  • base_delay: Initial delay between retries; doubles on each subsequent attempt.

Trait Implementations§

Source§

impl LlmProvider for RetryProvider

Source§

fn complete<'life0, 'life1, 'life2, 'life3, 'async_trait>( &'life0 self, system_prompt: &'life1 str, user_prompt: &'life2 str, config: &'life3 CompletionConfig, ) -> Pin<Box<dyn Future<Output = Result<String, ProviderError>> + Send + 'async_trait>>
where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait, 'life3: 'async_trait,

Sends a completion request to the LLM provider. Read more
Source§

fn name(&self) -> &str

Returns the provider’s name (e.g., “claude”, “claude-cli”, “openai”).
Source§

fn model(&self) -> &str

Returns the model identifier (e.g., “claude-sonnet-4-6”).

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.