Skip to main content

LfuCache

Struct LfuCache 

Source
pub struct LfuCache<K, V> { /* private fields */ }
Available on crate feature std only.
Expand description

A bounded, thread-safe LFU cache.

Each entry carries a counter that is incremented on every get or insert of an already-present key. On overflow, the entry with the lowest counter is evicted; ties are broken in favour of evicting the least-recently-accessed entry.

contains_key is a query and does not increment the counter or touch access order.

§Implementation

Sharded into up to 16 independent stores keyed by hash of K. Each shard pairs a HashMap<K, Entry<V>> for value lookup with a BTreeMap<(count, age), K> ordered priority index for O(log n) eviction.

Eviction is per-shard approximate LFU — the entry evicted on overflow is the lowest-counter entry in the affected shard, not necessarily the lowest-counter entry globally. Tiny caches (< 32 entries) use a single shard and retain strict global semantics.

§Example

use cache_mod::{Cache, LfuCache};

let cache: LfuCache<&'static str, u32> = LfuCache::new(2).expect("capacity > 0");

cache.insert("a", 1);
cache.insert("b", 2);

assert_eq!(cache.get(&"a"), Some(1));
assert_eq!(cache.get(&"a"), Some(1));

cache.insert("c", 3);
assert_eq!(cache.get(&"b"), None);
assert_eq!(cache.get(&"a"), Some(1));
assert_eq!(cache.get(&"c"), Some(3));

Implementations§

Source§

impl<K, V> LfuCache<K, V>
where K: Eq + Hash + Clone, V: Clone,

Source

pub fn new(capacity: usize) -> Result<Self, CacheError>

Creates a cache with the given capacity.

Returns CacheError::InvalidCapacity if capacity == 0.

§Example
use cache_mod::LfuCache;

let cache: LfuCache<String, u32> = LfuCache::new(128).expect("capacity > 0");
Source

pub fn with_capacity(capacity: NonZeroUsize) -> Self

Creates a cache with the given non-zero capacity. Infallible.

§Example
use std::num::NonZeroUsize;
use cache_mod::LfuCache;

let cap = NonZeroUsize::new(64).expect("64 != 0");
let cache: LfuCache<String, u32> = LfuCache::with_capacity(cap);

Trait Implementations§

Source§

impl<K, V> Cache<K, V> for LfuCache<K, V>
where K: Eq + Hash + Clone, V: Clone,

Source§

fn get(&self, key: &K) -> Option<V>

Returns the value associated with key, if any, and counts as an access for the purposes of the eviction policy.
Source§

fn insert(&self, key: K, value: V) -> Option<V>

Inserts value under key. Returns the previously-stored value if key was already present. Read more
Source§

fn remove(&self, key: &K) -> Option<V>

Removes the entry for key and returns the value if present.
Source§

fn contains_key(&self, key: &K) -> bool

Returns true if the cache currently holds an entry for key. Read more
Source§

fn len(&self) -> usize

Number of entries currently stored. Read more
Source§

fn clear(&self)

Removes every entry. Capacity is preserved. Read more
Source§

fn capacity(&self) -> usize

Configured capacity bound. Read more
Source§

fn is_empty(&self) -> bool

Returns true when the cache holds no entries.

Auto Trait Implementations§

§

impl<K, V> Freeze for LfuCache<K, V>

§

impl<K, V> RefUnwindSafe for LfuCache<K, V>

§

impl<K, V> Send for LfuCache<K, V>
where K: Send, V: Send,

§

impl<K, V> Sync for LfuCache<K, V>
where K: Send, V: Send,

§

impl<K, V> Unpin for LfuCache<K, V>

§

impl<K, V> UnsafeUnpin for LfuCache<K, V>

§

impl<K, V> UnwindSafe for LfuCache<K, V>

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.