Struct BroadcastConcurrencyManager 

pub struct BroadcastConcurrencyManager<Res>
where
    Res: CacheableResponse,
{ /* private fields */ }

Broadcast-based concurrency manager that prevents dogpile effect with semaphore-based concurrency control

When multiple requests arrive for the same cache key:

• First N requests (where N = semaphore capacity) proceed to upstream
• Subsequent requests subscribe to the broadcast channel and wait
• First request to complete broadcasts the result to all waiters
• Waiters reconstruct the response using CacheableResponse::from_cached

Implementations

impl<Res> BroadcastConcurrencyManager<Res>

where Res: CacheableResponse,

pub fn new() -> BroadcastConcurrencyManager<Res>

Creates a new broadcast-based concurrency manager.

Trait Implementations

impl<Res> Clone for BroadcastConcurrencyManager<Res>

where Res: CacheableResponse,

fn clone(&self) -> BroadcastConcurrencyManager<Res>

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<Res> ConcurrencyManager<Res> for BroadcastConcurrencyManager<Res>

where Res: CacheableResponse + Send + 'static, <Res as CacheableResponse>::Cached: Send + Sync + Clone + 'static,

fn check( &self, cache_key: &CacheKey, concurrency: BoundedU8<1, u8::MAX>, ) -> ConcurrencyDecision<Res>

Check if this request should proceed to upstream or await an existing request

fn resolve( &self, cache_key: &CacheKey, cache_value: &CacheValue<<Res as CacheableResponse>::Cached>, )

Notify waiting requests that the response is ready and return it back

fn cleanup(&self, cache_key: &CacheKey)

Cleanup stale entry from in-flight map (e.g., after channel closed error)

impl<Res> Default for BroadcastConcurrencyManager<Res>

where Res: CacheableResponse,

fn default() -> BroadcastConcurrencyManager<Res>

Returns the “default value” for a type.