Struct ResponseCache 

pub struct ResponseCache { /* private fields */ }

Implementations

impl ResponseCache

pub fn new(pool: SqlitePool, ttl_secs: u64) -> Self

pub async fn get(&self, key: &str) -> Result<Option<String>, MemoryError>

Look up a cached response by key. Returns None if not found or expired.

Errors

Returns an error if the database query fails.

pub async fn put( &self, key: &str, response: &str, model: &str, ) -> Result<(), MemoryError>

Store a response in the cache with TTL.

Errors

Returns an error if the database insert fails.

pub async fn cleanup_expired(&self) -> Result<u64, MemoryError>

Delete expired cache entries. Returns the number of rows deleted.

Errors

Returns an error if the database delete fails.

pub fn compute_key(messages: &[Message], model: &str) -> String

Compute a deterministic cache key from messages and model name using blake3.