Struct LlmRetryPolicy 

pub struct LlmRetryPolicy {
    pub max_attempts_per_model: usize,
    pub initial_backoff_ms: u64,
    pub max_backoff_ms: u64,
    pub retry_stream_start: bool,
}

Retry strategy for LLM inference calls.

Fields

max_attempts_per_model: usize

Max attempts per model candidate (must be >= 1).

initial_backoff_ms: u64

Initial backoff for retries in milliseconds.

max_backoff_ms: u64

Max backoff cap in milliseconds.

retry_stream_start: bool

Retry stream startup failures before any output is emitted.

Trait Implementations

impl Clone for LlmRetryPolicy

fn clone(&self) -> LlmRetryPolicy

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LlmRetryPolicy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for LlmRetryPolicy

fn default() -> Self

Returns the “default value” for a type.