Expand description
LRU embedding cache with memory-bounded eviction and per-model invalidation.
Structsยง
- Cache
Entry - A single cached embedding entry.
- Cache
Key - Cache key: content hash + model identifier.
- Cache
Stats - Cache statistics snapshot.
- Embedding
Cache - LRU embedding cache with a fixed entry-count capacity.
- Memory
Bounded Cache - An
EmbeddingCachevariant that evicts entries when total memory exceeds a byte limit.