Struct RetryingModel 

pub struct RetryingModel<M> { /* private fields */ }

Decorator that retries setup-time failures of an inner CompletionModel using exponential backoff with optional jitter, honouring Retry-After when the inner error provides it.

Implementations

impl<M> RetryingModel<M>

pub fn new(inner: M) -> Self

Wrap inner with RetryConfig::default.

pub fn with_config(inner: M, config: RetryConfig) -> Self

Wrap inner with explicit retry settings.

pub fn inner(&self) -> &M

Borrow the wrapped model. Useful for tests that need to assert on the inner state without unwrapping.

pub fn into_inner(self) -> M

Unwrap and return the inner model, dropping the retry layer.

Trait Implementations

impl<M> CompletionModel for RetryingModel<M>

where M: CompletionModel + Send + Sync, M::Error: Retryable,

type Error = <M as CompletionModel>::Error

Error type for the model’s transport / setup failures. Implement crate::Retryable on it to make the model composable with RetryingModel.

fn name(&self) -> &str

Adapter family name used in telemetry, e.g. "anthropic" or "azure-openai". Stable across model ids — changing model name does not change this.

fn model(&self) -> &str

Model identifier this handle is bound to: Anthropic model id ("claude-sonnet-4-5"), Azure deployment name, etc. The engine surfaces this in tracing and the JSON tracer envelope.

fn chat_stream<'life0, 'async_trait>( &'life0 self, req: ChatRequest, ) -> Pin<Box<dyn Future<Output = Result<BoxStream<'static, Result<StreamChunk, Self::Error>>, Self::Error>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Open a streaming completion. Returns a stream of Result<StreamChunk, Self::Error> so per-chunk transport errors can be surfaced mid-stream. Setup-time failures (auth, schema, transport open) return the outer Err.