Skip to main content

Module eviction

Module eviction 

Source
Expand description

§Cache Eviction Policies & Memory Pressure Management

Provides intelligent sequence eviction strategies (LRU) when the physical KV-cache block pool encounters high memory pressure.

Structs§

LruEvictionPolicy
Least-Recently-Used (LRU) eviction policy tracking access timestamps.

Traits§

EvictionPolicy
Abstract interface for sequence cache eviction policies.