Struct ResponseCache 

pub struct ResponseCache { /* private fields */ }

The response cache — bounded LRU with TTL eviction.

Implementations

impl ResponseCache

pub fn new(capacity: usize, ttl: Duration) -> Self

pub fn get(&mut self, key: u64) -> Option<&str>

Look up a cache key. Returns the cached response if found and not expired.

pub fn put(&mut self, key: u64, response: String, _output_tokens: u64)

Insert a response into the cache.

pub fn len(&self) -> usize

pub fn is_empty(&self) -> bool

Trait Implementations

impl Debug for ResponseCache

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.