Struct EmbeddingCache 

pub struct EmbeddingCache { /* private fields */ }

嵌入缓存

使用 LRU 策略管理缓存条目。

Implementations

impl EmbeddingCache

pub fn new(max_entries: usize, ttl_secs: u64) -> Self

创建新的缓存实例

pub fn default_cache() -> Self

使用默认配置创建缓存

pub async fn get( &self, provider: &str, model: &str, text: &str, ) -> Option<Vec<f32>>

获取缓存的嵌入向量

pub async fn put( &self, provider: &str, model: &str, text: &str, embedding: Vec<f32>, )

存储嵌入向量到缓存

pub async fn get_batch( &self, provider: &str, model: &str, texts: &[String], ) -> Vec<Option<Vec<f32>>>

批量获取缓存的嵌入向量

pub async fn clear(&self)

清空缓存

pub async fn stats(&self) -> CacheStats

获取缓存统计信息

Trait Implementations

impl Debug for EmbeddingCache

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.