Skip to main content

Module cache

Module cache 

Source
Expand description

A shared byte budget for cached groups, reclaimed with LRU eviction.

Every group registers its cached bytes in a Pool. When the pool exceeds its capacity, the least-recently-read groups are aborted with Error::Evicted, freeing their frames immediately. The latest group of each track is pinned and never evicted, so the live edge always survives memory pressure.

A pool is inert by default (Pool::unbounded): publishers and subscribers that never set a capacity pay only a couple of atomic counters. A relay creates one bounded pool and shares it across every origin so the whole process caches into a single budget.

Structsยง

Pool
A shared byte budget that caches charge into; cloning shares the same budget.