Struct ConcurrencyLimit 

pub struct ConcurrencyLimit<S, A, C = DefaultClassifier> { /* private fields */ }

Enforces an adaptive limit on the concurrent number of requests the underlying service can handle.

Unlike a static concurrency limit, ConcurrencyLimit continuously observes request latency and adjusts the number of allowed in-flight requests using the configured Algorithm.

Use ConcurrencyLimitLayer to integrate with tower::ServiceBuilder.

Implementations

impl<S, A> ConcurrencyLimit<S, A>

where A: Algorithm,

pub fn new(inner: S, algorithm: A) -> Self

Creates a new concurrency limiter.

impl<S, A, C> ConcurrencyLimit<S, A, C>

where A: Algorithm,

pub fn with_classifier(inner: S, algorithm: A, classifier: C) -> Self

Creates a new concurrency limiter with a custom Classifier.

pub fn get_ref(&self) -> &S

Gets a reference to the inner service.

pub fn get_mut(&mut self) -> &mut S

Gets a mutable reference to the inner service.

pub fn into_inner(self) -> S

Consumes self, returning the inner service.

Trait Implementations

impl<S: Clone, A, C: Clone> Clone for ConcurrencyLimit<S, A, C>

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<S: Debug, A, C> Debug for ConcurrencyLimit<S, A, C>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<S, A, C, Request> Service<Request> for ConcurrencyLimit<S, A, C>

where S: Service<Request>, A: Algorithm, C: Classifier<S::Response, S::Error> + Clone,

type Response = <S as Service<Request>>::Response

Responses given by the service.

type Error = <S as Service<Request>>::Error

Errors produced by the service.

type Future = ResponseFuture<<S as Service<Request>>::Future, A, C>

The future response value.

fn poll_ready(&mut self, cx: &mut Context<'_>) -> Poll<Result<(), Self::Error>>

Returns Poll::Ready(Ok(())) when the service is able to process requests.

fn call(&mut self, request: Request) -> Self::Future

Process the request and return the response asynchronously.