Struct RetryPolicy 

pub struct RetryPolicy {
    pub max_attempts: u32,
    pub base_delay: Duration,
    pub job_timeout: Duration,
}

How a transient inference failure is retried before the agent is failed.

Transient errors (see ProviderError::is_transient) are retried with exponential backoff; a permanent error (auth, invalid request, token limit) fails immediately. This keeps a passing network blip from marking a stage error and carrying its half-finished work forward.

Fields

max_attempts: u32

Total attempts including the first (e.g. 4 = one try + three retries).

base_delay: Duration

Base backoff; the retry after attempt n waits base_delay * 2^(n-1) (so 1s, 2s, 4s, … for a 1s base).

job_timeout: Duration

Hard ceiling on the total wall-clock time one job (all attempts + backoffs) may run before it is aborted and its pool slot freed.

Providers apply this same deadline as their own per-call timeout, so a call normally ends there. This outer bound is the backstop: a provider timer can be defeated (e.g. a connection that keeps trickling keepalive bytes without ever completing resets a read timer forever), which would leak the permit until the model’s pool fills and new agents never get a slot. Wrapping the whole job in a wall-clock timeout guarantees the slot is released within a fixed time regardless. Defaults to leviath_providers::DEFAULT_INFERENCE_TIMEOUT_SECS; a stage’s request_timeout_secs overrides it per stage.

Trait Implementations

impl Clone for RetryPolicy

fn clone(&self) -> RetryPolicy

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for RetryPolicy

impl Debug for RetryPolicy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for RetryPolicy

fn default() -> Self

Returns the “default value” for a type.