Expand description
Semantic query cache with TTL expiry, LRU eviction, and hit/miss statistics.
Caches semantic search results keyed by query embedding fingerprint (FNV-1a). Entries expire after a configurable number of ticks and are evicted in LRU order when the cache reaches its capacity limit.
Structsยง
- Cached
Query Result - A single cached search result entry, keyed by query embedding fingerprint.
- Query
Cache Config - Configuration for a
SemanticQueryCacheinstance. - Query
Cache Stats - Accumulated statistics for a
SemanticQueryCacheinstance. - Semantic
Query Cache - An in-memory cache for semantic search results with: