Expand description
LRU embedding cache with hit/miss tracking. LRU cache for computed embeddings to avoid recomputation.
Structsยง
- Cache
Stats - Statistics about cache usage.
- Cached
Embedding - A cached embedding entry.
- Embedding
Cache - LRU cache for embedding vectors, keyed by hash of (model_name + text).