Struct ToolCache 

pub struct ToolCache<V> { /* private fields */ }

LRU cache for tool results, keyed by (tool_name, args).

V is the cached value type. Use ToolCache::new, optionally chaining ToolCache::with_capacity and ToolCache::with_ttl to configure the cache:

use std::time::Duration;
use tool_result_cache::ToolCache;

let _cache: ToolCache<String> = ToolCache::new()
    .with_capacity(256)
    .with_ttl(Duration::from_secs(60));

Implementations

impl<V> ToolCache<V>

pub fn new() -> Self

Create a new cache with a default capacity of 1024 and no TTL.

Capacity-based eviction only kicks in once the cache holds more than max_size entries. Use ToolCache::with_capacity or ToolCache::with_ttl to override.

pub fn with_capacity(self, max_size: usize) -> Self

Set the maximum number of entries; 0 disables capacity-based eviction.

pub fn with_ttl(self, ttl: Duration) -> Self

Set the default TTL for new entries. Per-call TTLs override this value.

pub fn with_clock<F>(self, clock: F) -> Self

where F: Fn() -> Instant + Send + Sync + 'static,

Replace the cache clock. Default is Instant::now. Intended for tests.

pub fn len(&self) -> usize

Number of cached entries currently held.

pub fn is_empty(&self) -> bool

true if the cache currently holds no entries.

pub fn hits(&self) -> u64

Number of get / get_or_set calls that found a live entry.

pub fn misses(&self) -> u64

Number of get / get_or_set calls that did not find a live entry.

pub fn evictions(&self) -> u64

Number of entries dropped because the cache exceeded its capacity.

pub fn expirations(&self) -> u64

Number of entries dropped because their TTL elapsed.

pub fn stats(&self) -> CacheStats

Snapshot of all counters at this point in time. The snapshot is a copy and will not change as the cache continues to be used.

pub fn clear(&mut self)

Drop all entries and reset statistics.

pub fn get(&mut self, tool_name: &str, args: &Value) -> Option<&V>

Look up a cached value by tool name + args. Updates hit/miss stats.

pub fn set(&mut self, tool_name: &str, args: &Value, value: V)

Insert or replace a cached value using the cache’s default TTL.

pub fn set_with_ttl( &mut self, tool_name: &str, args: &Value, value: V, ttl: Duration, )

Insert or replace a cached value with a per-call TTL override.

pub fn get_or_set<F>(&mut self, tool_name: &str, args: &Value, compute: F) -> &V

where F: FnOnce() -> V,

Return the cached value if present, else call compute and cache it.

pub fn get_or_set_with_ttl<F>( &mut self, tool_name: &str, args: &Value, compute: F, ttl: Duration, ) -> &V

where F: FnOnce() -> V,

Same as ToolCache::get_or_set but with a per-call TTL override.

pub fn invalidate(&mut self, tool_name: &str, args: &Value) -> bool

Drop a single entry. Returns true if it was present.

Trait Implementations

impl<V> Default for ToolCache<V>

fn default() -> Self

Returns the “default value” for a type.