Struct AnswerCache 

pub struct AnswerCache { /* private fields */ }

In-memory LRU cache for answers Thread-safe with a simple mutex

Implementations

impl AnswerCache

pub fn new(max_size: usize) -> Self

Create a new cache with the specified maximum size

pub fn make_key(query: &str, context: &str, model: &str) -> [u8; 32]

Generate a cache key from query and context

pub fn get(&self, key: &[u8; 32]) -> Option<CacheEntry>

Look up an entry in the cache

pub fn insert(&self, key: [u8; 32], entry: CacheEntry)

Insert an entry into the cache

pub fn clear(&self)

Clear the cache

pub fn stats(&self) -> CacheStats

Get cache statistics

pub fn estimated_savings(&self) -> f64

Estimated cost savings from cache hits

Trait Implementations

impl Default for AnswerCache

fn default() -> Self

Returns the “default value” for a type.