Expand description
HTTP retry / backoff / Retry-After helpers for LLM providers.
Retries happen ONLY before the streaming response begins. Once the helper
returns Ok(Response), the caller owns the stream and any error during
SSE iteration must NOT be retried — partial deltas may already have reached
the user.
Structs§
- Retry
Policy - Retry configuration.
Functions§
- send_
with_ retry - Async retry wrapper for streaming providers.
- send_
with_ retry_ blocking - Blocking variant for sync code paths (e.g. OAuth token refresh in
create_provider). Same contract assend_with_retry: builder-chain errors are surfaced asreqwest::Errorrather than panics.