Expand description
§Semantic Embedding Cache
Cache for computed embeddings to avoid re-computation. Provides TTL-based expiry, LRU batch eviction, prefix invalidation, and hit/miss statistics.
Structs§
- Cached
Embedding - A single cached embedding entry.
- Embedding
Cache Config - Configuration for
SemanticEmbeddingCache. - Embedding
Cache Stats - Aggregate statistics for the cache.
- Semantic
Embedding Cache - A tick-based embedding cache with LRU batch eviction and TTL expiry.