Struct ShardedCache 

pub struct ShardedCache { /* private fields */ }

A high-performance sharded cache using DashMap.

This cache implementation:

• Uses DashMap for lock-free concurrent reads
• Automatically notifies watches on snapshot updates
• Tracks statistics for monitoring

Thread Safety

All operations are thread-safe. The cache uses DashMap internally, which provides fine-grained locking at the bucket level rather than a global lock.

Important

All DashMap references are dropped before any async operations to prevent holding locks across await points.

Implementations

impl ShardedCache

pub fn new() -> Self

Create a new sharded cache with default settings.

pub fn with_capacity(capacity: usize) -> Self

Create a new sharded cache with a specific initial capacity.

pub fn watches(&self) -> &WatchManager

Get the watch manager for creating watches.

pub fn stats(&self) -> &CacheStats

Get cache statistics.

pub fn create_watch(&self, node: NodeHash) -> Watch

Create a watch for a node.

The watch will receive updates when the snapshot for this node changes. If a snapshot already exists, the caller should check with get_snapshot first.

pub fn cancel_watch(&self, watch_id: WatchId)

Cancel a watch.

pub fn nodes(&self) -> Vec<NodeHash>

Get all node hashes in the cache.

pub fn has_snapshot(&self, node: NodeHash) -> bool

Check if a snapshot exists for a node.

pub fn iter(&self) -> impl Iterator<Item = (NodeHash, Arc<Snapshot>)> + '_

Iterate over all snapshots.

Note: This acquires read locks on all shards.

Trait Implementations

impl Cache for ShardedCache

fn get_snapshot(&self, node: NodeHash) -> Option<Arc<Snapshot>>

Get a snapshot for a node.

fn set_snapshot(&self, node: NodeHash, snapshot: Snapshot)

Set a snapshot for a node.

fn clear_snapshot(&self, node: NodeHash)

Clear the snapshot for a node.

fn snapshot_count(&self) -> usize

Get the number of cached snapshots.

impl Debug for ShardedCache

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ShardedCache

fn default() -> Self

Returns the “default value” for a type.