Struct CacheStorage 

pub struct CacheStorage { /* private fields */ }

Thread-safe in-memory cache storage with LRU eviction.

Thread Safety

All operations are thread-safe and can be called concurrently from multiple threads (e.g., Rayon parallel queries or MCP server requests).

Eviction Policy

Uses an incremental LRU cache with Mutex protection to prevent race conditions. When the cache exceeds max_bytes, the least recently used entries are evicted until the size drops below the cap.

Examples

use sqry_core::cache::{CacheStorage, CacheKey};

let storage = CacheStorage::new(50 * 1024 * 1024); // 50 MB

// Thread-safe insert
storage.insert(key, summaries);

// Thread-safe get (updates LRU)
if let Some(summaries) = storage.get(&key) {
    // Use summaries
}

// Check stats
let stats = storage.stats();
println!("Size: {} bytes, Entries: {}", stats.total_bytes, stats.entry_count);

Implementations

impl CacheStorage

pub fn new(max_bytes: u64) -> Self

Create a new cache storage with the given size limit.

Arguments

• max_bytes: Maximum total cache size in bytes

Examples

use sqry_core::cache::CacheStorage;

let storage = CacheStorage::new(50 * 1024 * 1024); // 50 MB

pub fn with_policy(config: &CachePolicyConfig) -> Self

Create cache storage with a specific eviction policy configuration.

pub fn get(&self, key: &CacheKey) -> Option<Arc<[GraphNodeSummary]>>

Get cached summaries for a key.

Returns an Arc<[GraphNodeSummary]> to avoid cloning the entire vector on every cache hit. This provides zero-copy sharing of cached data.

Updates the LRU ordering on hit.

Returns

• Some(Arc<[GraphNodeSummary]>) if the key is in cache (hit)
• None if the key is not in cache (miss)

Examples

if let Some(summaries) = storage.get(&key) {
    // Cache hit - Arc clone is cheap (just bumps ref count)
    for summary in summaries.iter() {
        // Process symbols...
    }
}

pub fn insert(&self, key: CacheKey, summaries: Vec<GraphNodeSummary>)

Insert summaries into the cache.

Triggers eviction if the cache exceeds the size limit.

Arguments

• key: Cache key (file path + language + content hash)
• summaries: Node summaries to cache

Examples

storage.insert(key, vec![summary1, summary2]);

pub fn clear(&self)

Clear all entries from the cache.

Examples

storage.clear();

pub fn stats(&self) -> CacheStats

Get cache statistics.

Examples

let stats = storage.stats();
println!("Hit rate: {:.1}%", stats.hit_rate() * 100.0);