Module memory_cache

Module memory_cache 

Source
Expand description

In-memory caching module using pingora-memory-cache

This module provides fast in-memory caching for hot data like:

  • Route matching results
  • Parsed configuration fragments
  • Compiled regex patterns
  • Upstream selection hints

Uses S3-FIFO + TinyLFU eviction for excellent hit rates on skewed workloads.

Structsยง

MemoryCacheConfig
Configuration for the memory cache
MemoryCacheManager
Memory cache manager using pingora-memory-cache
MemoryCacheStats
Statistics for the memory cache
RouteMatchEntry
Route matching cache entry
TypedCache
Generic cache wrapper for arbitrary types