Skip to main content

Module cache

Module cache 

Source
Expand description

Multi-tier caching system Multi-tier caching system optimized for CPU cache efficiency

§Architecture

Request ──► Hot Cache (L1/L2 CPU) ──► Cold Cache (RAM) ──► Miss
             │ ~1-3ns latency        │ ~100ns latency
             │ 8 entries/thread      │ N entries shared
             └───────────────────────┘
  • Hot Cache: Thread-local, fits in L1/L2 CPU cache (~4KB per thread)
  • Cold Cache: Shared RAM cache with DashMap for lock-free access
  • Auto-promotion: Cold hits are promoted to hot cache

Re-exports§

pub use hot::HotCache;

Modules§

hot
Thread-local “hot” cache optimized for L1/L2 CPU cache

Structs§

CacheMetrics
Cache metrics snapshot
SsrCache
Multi-tier SSR cache