Struct RetryLayer 

pub struct RetryLayer { /* private fields */ }

Available on crate feature retry only.

Retries with a RetryPolicy, and optionally reads the body of a 429 to tell a permanent error from a rate limit first.

RetryLayer::new(policy) retries exactly like tower::retry::RetryLayer::new(policy). With RetryLayer::permanent_429, the body of each 429 is read (up to RetryLayer::body_limit) and given to a function; when it returns true, the response is marked Permanent and returned at once. The body is put back, so the caller (and a generated client’s error) still sees all of it.

use timvw_rust_runtime::retry::{openai_insufficient_quota, RetryLayer, RetryPolicy};
use timvw_rust_runtime::{Client, ReqwestService};

let client = Client::from_service(ReqwestService::default())
    .layer(RetryLayer::new(RetryPolicy::default()).permanent_429(openai_insufficient_quota));

Implementations

impl RetryLayer

pub fn new(policy: RetryPolicy) -> Self

Retries with policy, without reading any body.

pub fn permanent_429<F>(self, is_permanent: F) -> Self

where F: Fn(&[u8]) -> bool + Send + Sync + 'static,

Reads the body of each 429 and does not retry it when is_permanent returns true for the body’s bytes.

A body longer than RetryLayer::body_limit, or one that fails to read, is not given to is_permanent: the response is retried as a rate limit, and the caller still reads the whole body (or its error).

pub fn body_limit(self, limit: usize) -> Self

How many bytes of a 429 body are read to classify it (default DEFAULT_BODY_LIMIT, 64 KiB).

pub fn policy(&self) -> &RetryPolicy

The retry policy.

Trait Implementations

impl Clone for RetryLayer

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for RetryLayer

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for RetryLayer

Retries with RetryPolicy::default.

fn default() -> Self

Returns the “default value” for a type.

impl<S> Layer<S> for RetryLayer

type Service = Retry<RetryPolicy, Classify429<S>>

The wrapped service

fn layer(&self, inner: S) -> Self::Service

Wrap the given service with the middleware, returning a new service that has been decorated with the middleware.