Struct MemoryCacheManager 

pub struct MemoryCacheManager { /* private fields */ }

Memory cache manager using pingora-memory-cache

Provides high-performance caching with:

• S3-FIFO eviction (better than LRU for many workloads)
• TinyLFU admission policy (prevents cache pollution)
• Cache stampede protection

Implementations

impl MemoryCacheManager

pub fn new(config: MemoryCacheConfig) -> Self

Create a new memory cache manager

pub fn get_route_match(&self, key: &str) -> Option<RouteMatchEntry>

Look up a route match by cache key

pub fn put_route_match(&self, key: &str, entry: RouteMatchEntry)

Cache a route match result

pub fn put_route_match_with_ttl( &self, key: &str, entry: RouteMatchEntry, ttl: Duration, )

Cache a route match result with custom TTL

pub fn route_cache_key(method: &str, path: &str, host: Option<&str>) -> String

Generate a cache key for route matching

The key incorporates:

• HTTP method
• Request path
• Host header (for virtual hosting)

pub fn invalidate_route(&self, _route_id: &str)

Invalidate route cache entries for a specific route

Note: pingora-memory-cache doesn’t support iteration, so we can’t selectively invalidate. For now, we’d need to clear the entire cache on configuration reload.

pub fn clear(&self)

Clear all cached entries

Call this on configuration reload to ensure fresh routing decisions.

pub fn stats(&self) -> &MemoryCacheStats

Get cache statistics

pub fn config(&self) -> &MemoryCacheConfig

Get the cache configuration