Struct RetryingChatClient 

pub struct RetryingChatClient<C>
where
    C: ChatClient,
{ /* private fields */ }

A ChatClient decorator that retries transient failures with exponential backoff, honoring a server Retry-After when present.

Wraps any inner ChatClient and re-issues the request per its RetryPolicy. For streaming, only the initial connection is retried: if establishing the stream (or its very first item, before anything is yielded to the consumer) fails with a retryable error, the connection is re-attempted; once the first update flows, later stream errors propagate unchanged.

let client = RetryingChatClient::new(inner)
    .with_policy(RetryPolicy::with_max_retries(5).initial_delay(Duration::from_millis(200)));

Implementations

impl<C> RetryingChatClient<C>

where C: ChatClient,

pub fn new(inner: C) -> RetryingChatClient<C>

Wrap inner with the default RetryPolicy.

pub fn with_policy(self, policy: RetryPolicy) -> RetryingChatClient<C>

Set the retry policy (builder-style).

pub fn inner(&self) -> &C

A reference to the wrapped client.

pub fn policy(&self) -> &RetryPolicy

A reference to the active retry policy.

Trait Implementations

impl<C> ChatClient for RetryingChatClient<C>

where C: ChatClient,

fn get_response<'life0, 'async_trait>( &'life0 self, messages: Vec<Message>, options: ChatOptions, ) -> Pin<Box<dyn Future<Output = Result<ChatResponse, Error>> + Send + 'async_trait>>

where 'life0: 'async_trait, RetryingChatClient<C>: 'async_trait,

Get a complete (non-streaming) response.

fn get_streaming_response<'life0, 'async_trait>( &'life0 self, messages: Vec<Message>, options: ChatOptions, ) -> Pin<Box<dyn Future<Output = Result<Pin<Box<dyn Stream<Item = Result<ChatResponseUpdate, Error>> + Send>>, Error>> + Send + 'async_trait>>

where 'life0: 'async_trait, RetryingChatClient<C>: 'async_trait,

Get a streaming response as a sequence of updates.

fn model(&self) -> Option<&str>

The default model id for this client, if any.