Struct SpeculativeCache 

pub struct SpeculativeCache { /* private fields */ }

Implementations

impl SpeculativeCache

pub fn new( max_size: usize, keyword_threshold: f32, embedding_threshold: f32, ) -> Self

pub fn pre_assemble( &mut self, predictions: Vec<String>, builder: impl Fn(&str) -> Option<(String, Vec<MemoryId>, Option<Vec<f32>>)>, )

pub fn try_hit( &mut self, query: &str, query_embedding: Option<&[f32]>, ) -> Option<CacheEntry>

Try to find a cached context for this query. Uses cosine similarity on embeddings when available, falls back to keyword overlap only when no embeddings exist.

pub fn evict_stale(&mut self, max_age_us: u64, now: Timestamp)

pub fn stats(&self) -> CacheStats

pub fn entries(&self) -> &[CacheEntry]

The current cache entries (predicted topic, pre-assembled context, source memories, hit count, age), for introspection and display.

impl SpeculativeCache

pub fn save(&self, path: &Path, min_hits: u32) -> Result<()>

Save cache entries with at least min_hits to a JSON file. Entries below the threshold are considered stale and dropped. Uses atomic write (temp file + rename) to avoid corruption.

pub fn load(&mut self, path: &Path) -> Result<()>

Load cache entries from a JSON file, merging into the current cache. Preserves the configured max_size and thresholds. Resets last_accessed timestamps so LRU eviction works correctly after reload.

Trait Implementations

impl Default for SpeculativeCache

fn default() -> Self

Returns the “default value” for a type.