Skip to main content

Module cache

Module cache 

Source
Expand description

LRU embedding cache with hit/miss tracking. LRU cache for computed embeddings to avoid recomputation.

Structsยง

CacheStats
Statistics about cache usage.
CachedEmbedding
A cached embedding entry.
EmbeddingCache
LRU cache for embedding vectors, keyed by hash of (model_name + text).