Struct VersionedInferenceCache 

pub struct VersionedInferenceCache { /* private fields */ }

Concurrent, version-aware memoization cache for inference results.

Entries are keyed by (goal_hash, kb_id, kb_version). Calling bump_kb_version atomically increments the version for a given KB and removes every cached entry that was derived from that KB, regardless of their recorded version.

Concurrency

Read operations (get, current_kb_version, entry_count, stats) acquire a read lock; write operations acquire an exclusive write lock.

Implementations

impl VersionedInferenceCache

pub fn new(max_entries: usize) -> Self

Create a new cache with the given capacity limit.

If max_entries is 0 the default (10_000) is used.

pub fn insert(&self, key: CacheKey, entry: CacheEntry) -> Result<(), CacheError>

Insert a new entry.

Returns CacheError::CapacityExceeded when the cache is full. Returns CacheError::StaleVersion when key.kb_version is lower than the currently tracked version for key.kb_id.

If an entry with the same key already exists it is overwritten (the capacity check is skipped for replacements).

pub fn get(&self, key: &CacheKey) -> Option<CacheEntry>

Look up a cached entry by key.

Returns None if the entry is not found or if it has expired. On a hit the entry’s hit_count is incremented and a clone is returned.

pub fn current_kb_version(&self, kb_id: &str) -> u64

Return the current version for the given KB, or 0 if unknown.

pub fn bump_kb_version(&self, kb_id: &str) -> u64

Increment the version counter for kb_id and atomically invalidate all cached entries that were derived from that KB.

Returns the new version number.

pub fn invalidate_kb(&self, kb_id: &str)

Remove all cached entries whose kb_id matches, regardless of their recorded version.

This is called internally by bump_kb_version but can also be called directly (e.g., when a KB is deleted).

pub fn evict_expired(&self) -> usize

Remove all expired entries from the cache.

Returns the number of entries removed.

pub fn entry_count(&self) -> usize

Current number of entries in the cache (including possibly-expired ones).

pub fn stats(&self) -> CacheStatsSnapshot

Snapshot of the current statistics counters.

Trait Implementations

impl Default for VersionedInferenceCache

fn default() -> Self

Returns the “default value” for a type.