Struct Retrying 

pub struct Retrying<P: Provider> { /* private fields */ }

A Provider wrapper that retries transient failures with exponential backoff and full jitter, and bounds each attempt with a per-call timeout.

Scope: the retry policy applies to chat_completion only. Streaming (chat_completion_stream) skips retry — the connection is already established and clients consuming chunk-by-chunk handle their own resumption — but still bounds the connection-establishment phase with the same timeout. The non-chat methods (embedding, image_generation, audio_speech, audio_transcription) are bare pass-throughs without retry or timeout, because the daemon’s current protocol doesn’t expose these endpoints. If a future daemon feature needs them, extend this wrapper’s scope at that point.

Implementations

impl<P: Provider> Retrying<P>

pub fn new(inner: P) -> Self

Wrap a provider with the default retry policy (2 retries, 30s timeout, 100ms initial backoff).

Trait Implementations

impl<P: Clone + Provider> Clone for Retrying<P>

fn clone(&self) -> Retrying<P>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<P: Debug + Provider> Debug for Retrying<P>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<P: Provider> Provider for Retrying<P>

async fn chat_completion( &self, request: &ChatCompletionRequest, ) -> Result<ChatCompletionResponse, Error>

async fn chat_completion_stream( &self, request: &ChatCompletionRequest, ) -> Result<BoxStream<'static, Result<ChatCompletionChunk, Error>>, Error>

async fn embedding( &self, request: &EmbeddingRequest, ) -> Result<EmbeddingResponse, Error>

async fn image_generation( &self, request: &ImageRequest, ) -> Result<(Bytes, String), Error>

async fn audio_speech( &self, request: &AudioSpeechRequest, ) -> Result<(Bytes, String), Error>

async fn audio_transcription( &self, model: &str, fields: &[MultipartField], ) -> Result<(Bytes, String), Error>