Struct SimpleRetryPolicy 

pub struct SimpleRetryPolicy { /* private fields */ }

Available on crate features middleware and _api only.

Simple tower::retry::Policy for OpenAI compatible APIs.

SimpleRetryPolicy retries rate limits, server errors, and native connect errors. It can be used directly with tower::ServiceBuilder::retry around crate::middleware::ReqwestService or any compatible tower service whose request type is crate::middleware::HttpRequestFactory.

The default policy allows three retry attempts.

Implementations

impl SimpleRetryPolicy

pub fn new(max_retries: usize) -> Self

Create a policy that allows at most max_retries retry attempts.

This value is the number of additional attempts after the initial request, not the total number of requests.

pub fn max_retries(&self) -> usize

Number of retry attempts configured for this policy.

pub fn attempts(&self) -> usize

Number of retry attempts already consumed by this policy instance.

Trait Implementations

impl Clone for SimpleRetryPolicy

fn clone(&self) -> SimpleRetryPolicy

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for SimpleRetryPolicy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SimpleRetryPolicy

fn default() -> Self

Returns the “default value” for a type.

impl Policy<HttpRequestFactory, Response, OpenAIError> for SimpleRetryPolicy

type Future = Pin<Box<dyn Future<Output = ()> + Send>>

The Future type returned by Policy::retry.

fn retry( &mut self, _req: &mut HttpRequestFactory, result: &mut Result<Response, OpenAIError>, ) -> Option<Self::Future>

Check the policy if a certain request should be retried.

fn clone_request( &mut self, req: &HttpRequestFactory, ) -> Option<HttpRequestFactory>

Tries to clone a request before being passed to the inner service.