Struct TenantConcurrencyLimitLayer 

pub struct TenantConcurrencyLimitLayer { /* private fields */ }

Per-tenant concurrency limiter for kernel requests.

Each tenant key gets its own bounded tower concurrency service. Waiting for capacity in one tenant partition does not consume readiness for another tenant partition.

Implementations

impl TenantConcurrencyLimitLayer

pub fn new(per_tenant_limit: usize) -> Self

Create a new per-tenant concurrency limit layer.

pub fn with_max_tenants(self, max_tenants: usize) -> Self

Set the maximum number of tenant limiter buckets retained at once.

pub fn with_tenant_idle_reap_secs(self, secs: u64) -> Self

Set the idle window after which an unused tenant bucket may be reaped so a new tenant is not permanently blocked by a full table.

Trait Implementations

impl Clone for TenantConcurrencyLimitLayer

fn clone(&self) -> TenantConcurrencyLimitLayer

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TenantConcurrencyLimitLayer

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<S> Layer<S> for TenantConcurrencyLimitLayer

type Service = TenantConcurrencyLimitService<S>

The wrapped service

fn layer(&self, inner: S) -> Self::Service

Wrap the given service with the middleware, returning a new service that has been decorated with the middleware.