Expand description
Cache for LLM answers to avoid redundant API calls Uses Blake3 hash of (query + context) as the key
Structs§
- Answer
Cache - In-memory LRU cache for answers Thread-safe with a simple mutex
- Cache
Entry - Cached answer entry
- Cache
Stats - GLOBAL_
CACHE
Functions§
- check_
cache - Check cache and return cached result if available
- clear_
global_ cache - Clear the global cache
- global_
stats - Get global cache statistics
- store_
in_ cache - Store result in cache