Enum EmbeddingCacheMsg 

pub enum EmbeddingCacheMsg {
    Get {
        key: Vec<u8>,
        reply: Sender<Option<Vec<f32>>>,
    },
    Insert {
        key: Vec<u8>,
        value: Vec<f32>,
        reply: Sender<()>,
    },
    Invalidate {
        key: Vec<u8>,
        reply: Sender<bool>,
    },
    Stats {
        reply: Sender<CacheStats>,
    },
}

Variants

Get

Try the cache. On miss, returns None and the caller is responsible for computing + storing the embedding via Insert. F4 keeps cache and compute decoupled.

Fields

key: Vec<u8>

reply: Sender<Option<Vec<f32>>>

Insert

Fields

key: Vec<u8>

value: Vec<f32>

reply: Sender<()>

Invalidate

Fields

key: Vec<u8>

reply: Sender<bool>

Stats

Fields

reply: Sender<CacheStats>