Struct L0Cache 

pub struct L0Cache { /* private fields */ }

L0 cache implementation using DashMap for lock-free reads.

Uses two separate maps (one per add_special_tokens value) so that lookups can borrow the key as &str without allocating a String.

Eviction uses approximate LRU: when capacity is reached, sample a few entries and evict the one with the oldest last_accessed timestamp.

Implementations

impl L0Cache

pub fn new(max_entries: usize) -> Self

Create a new L0 cache with the specified capacity

pub fn get(&self, key: &str, add_special_tokens: bool) -> Option<Arc<Encoding>>

Get an encoding from the cache (returns Arc for zero-copy access). Zero-allocation on the lookup path.

pub fn insert(&self, key: String, add_special_tokens: bool, value: Encoding)

Insert an encoding into the cache

pub fn insert_arc( &self, key: String, add_special_tokens: bool, value: Arc<Encoding>, )

Insert a pre-wrapped Arc encoding into the cache (avoids double-wrapping)

pub fn len(&self) -> usize

Get the current number of entries in the cache

pub fn is_empty(&self) -> bool

Check if the cache is empty

pub fn stats(&self) -> CacheStats

Get cache statistics

pub fn clear(&self)

Clear the cache

pub fn memory_usage(&self) -> usize

Estimate memory usage in bytes