Expand description
Retry logic and streaming fallback handling.
When streaming fails mid-response, the retry handler can:
- Discard partial tool executions with synthetic error blocks
- Fall back to a smaller model on repeated overload errors
- Apply exponential backoff with jitter
Structs§
- Retry
Config - Retry configuration.
- Retry
State - State tracker for retry logic across multiple attempts.
Enums§
- Retry
Action - Action the caller should take after a failure.
- Retryable
Error - Categorized error for retry logic.