Struct MemoryRerankCache 

pub struct MemoryRerankCache { /* private fields */ }

LRU 内存缓存实现

Implementations

impl MemoryRerankCache

pub fn new(max_entries: usize) -> Self

创建新的 LRU 内存缓存

max_entries 指定缓存中最多保留的条目数，超出时会淘汰最久未使用的条目。

Trait Implementations

impl Debug for MemoryRerankCache

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl RerankCache for MemoryRerankCache

fn get<'life0, 'life1, 'life2, 'async_trait>( &'life0 self, query: &'life1 str, candidate_ids: &'life2 [String], ) -> Pin<Box<dyn Future<Output = Option<RerankResult>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

获取缓存结果

fn set<'life0, 'life1, 'life2, 'life3, 'async_trait>( &'life0 self, query: &'life1 str, candidate_ids: &'life2 [String], result: &'life3 RerankResult, ttl: Duration, ) -> Pin<Box<dyn Future<Output = ()> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait, 'life3: 'async_trait,

存储缓存结果