Struct L1Cache 

pub struct L1Cache { /* private fields */ }

In-memory exact-match cache keyed by prompt hash.

Implementations

impl L1Cache

pub fn new() -> Self

Creates a cache with the default capacity.

pub fn with_capacity(capacity: u64) -> Self

Creates a cache with a max entry capacity (LRU eviction).

pub fn lookup(&self, prompt: &str) -> Option<L1LookupResult>

Looks up a prompt by hashing it with hash_prompt.

pub fn lookup_by_hash(&self, hash: &[u8; 32]) -> Option<L1LookupResult>

Looks up an entry by a precomputed 32-byte hash.

pub fn insert(&self, prompt: &str, handle: MmapFileHandle) -> [u8; 32]

Inserts a prompt → handle mapping and returns the computed hash.

pub fn insert_by_hash(&self, hash: [u8; 32], handle: MmapFileHandle)

Inserts a precomputed hash → handle mapping.

pub fn remove(&self, hash: &[u8; 32]) -> Option<MmapFileHandle>

Removes an entry by hash.

pub fn remove_prompt(&self, prompt: &str) -> Option<MmapFileHandle>

Removes an entry by prompt (hashing it first).

pub fn len(&self) -> u64

Returns the number of cached entries.

pub fn is_empty(&self) -> bool

Returns true if the cache is empty.

pub fn clear(&self)

Clears all entries.

pub fn contains_hash(&self, hash: &[u8; 32]) -> bool

Returns true if the cache contains the given hash.

pub fn contains_prompt(&self, prompt: &str) -> bool

Returns true if the cache contains the given prompt.

pub fn run_pending_tasks(&self)

Runs any pending maintenance tasks in the underlying cache.

pub fn hashes(&self) -> impl Iterator<Item = [u8; 32]>

Returns an iterator of currently stored hashes.

Trait Implementations

impl Debug for L1Cache

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for L1Cache

fn default() -> Self

Returns the “default value” for a type.