Expand description
Vector embedding cache with LRU eviction.
Provides an in-memory cache for embedding vectors with:
- LRU eviction (configurable max entries)
- Cache warming (preload frequently accessed vectors)
- Hit/miss statistics tracking
- Memory-bounded eviction
- Cache invalidation (by key, by prefix, clear all)
- Optional per-entry TTL-based expiry
- Batch get/put operations
- Cache persistence (save/load)
Structsยง
- Cache
Snapshot - A serializable representation of the cache for persistence.
- Cache
Statistics - Hit/miss statistics for the cache.
- Vector
Cache - An LRU cache for embedding vectors.
- Vector
Cache Config - Configuration for the vector cache.