Struct LlmRetryConfig 

pub struct LlmRetryConfig {
    pub max_retries: u32,
    pub initial_backoff: Duration,
    pub max_backoff: Duration,
    pub backoff_multiplier: f64,
    pub jitter_factor: f64,
}

Configuration for LLM rate limit retry behavior.

Defaults match official Anthropic/OpenAI SDK behavior:

• max_retries: 2
• initial_backoff: 1 second
• max_backoff: 60 seconds
• backoff_multiplier: 2.0
• jitter_factor: 0.25 (±25%)

Fields

max_retries: u32

Maximum number of retry attempts (0 = no retries)

initial_backoff: Duration

Initial backoff duration (before exponential increase)

max_backoff: Duration

Maximum backoff duration (cap for exponential growth)

backoff_multiplier: f64

Backoff multiplier (typically 2.0 for exponential)

jitter_factor: f64

Jitter factor (0.0-1.0, adds randomness to avoid thundering herd) Official SDKs use 0.25 (±25%)

Implementations

impl LlmRetryConfig

pub fn no_retry() -> LlmRetryConfig

Create a config with no retries (fail immediately on rate limit)

pub fn aggressive() -> LlmRetryConfig

Create a config with aggressive retry settings (more retries, longer waits)

pub fn calculate_backoff(&self, attempt: u32) -> Duration

Calculate backoff duration for a given attempt number (0-indexed)

Trait Implementations

impl Clone for LlmRetryConfig

fn clone(&self) -> LlmRetryConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LlmRetryConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Default for LlmRetryConfig

fn default() -> LlmRetryConfig

Returns the “default value” for a type.