Skip to main content

WTinyLfuCache

Struct WTinyLfuCache 

Source
pub struct WTinyLfuCache<K, V> { /* private fields */ }
Expand description

Window TinyLFU cache with near-optimal hit rates on skewed workloads.

§Capacity split

window_cap    = max(1, total_cap / 100)
main_cap      = total_cap - window_cap
protected_cap = main_cap * 4 / 5

§Type parameters

  • K: key type — must be Eq + Hash + Clone.
  • V: value type.

Implementations§

Source§

impl<K, V> WTinyLfuCache<K, V>
where K: Eq + Hash + Clone,

Source

pub fn new(total_cap: usize) -> Self

Create a new WTinyLfuCache with the given total capacity.

Minimum capacity is 2.

Source

pub fn get(&mut self, key: &K) -> Option<&V>

Look up key, updating recency and frequency.

Expired entries are lazily removed and treated as misses.

Source

pub fn put(&mut self, key: K, value: V) -> Option<V>

Insert or update key -> value without TTL.

Source

pub fn put_with_ttl(&mut self, key: K, value: V, ttl: Duration) -> Option<V>

Insert or update key -> value with a TTL.

Source

pub fn len(&self) -> usize

Total number of live entries.

Source

pub fn is_empty(&self) -> bool

Return true if the cache holds no entries.

Source

pub fn cap(&self) -> usize

Total capacity.

Source

pub fn peek(&self, key: &K) -> Option<&V>

Read a value without updating recency or frequency.

Returns None if absent or expired.

Source

pub fn contains_key(&self, key: &K) -> bool

Return true if key is present and not expired (no recency update).

Source

pub fn remove(&mut self, key: &K) -> Option<V>

Remove the entry for key, returning its value if present.

Source

pub fn clear(&mut self)

Remove all entries from the cache.

Source

pub fn resize(&mut self, new_cap: usize)

Dynamically resize the cache capacity.

Recomputes segment sizes and evicts LRU entries as needed.

Trait Implementations§

Source§

impl<K, V> Cache<K, V> for WTinyLfuCache<K, V>
where K: Eq + Hash + Clone,

Source§

fn get(&mut self, key: &K) -> Option<&V>

Look up key, returning a reference to the value if present. Read more
Source§

fn put(&mut self, key: K, value: V) -> Option<V>

Insert or update key -> value without a TTL. Read more
Source§

fn put_with_ttl(&mut self, key: K, value: V, ttl: Duration) -> Option<V>

Insert or update key -> value with a time-to-live. Read more
Source§

fn len(&self) -> usize

Return the number of live entries currently in the cache.
Source§

fn cap(&self) -> usize

Return the maximum number of entries the cache can hold.
Source§

fn remove(&mut self, key: &K) -> Option<V>

Remove the entry associated with key, returning its value if present. Read more
Source§

fn clear(&mut self)

Remove all entries from the cache.
Source§

fn peek(&self, key: &K) -> Option<&V>

Look up key without updating access metadata (no promotion). Read more
Source§

fn contains_key(&self, key: &K) -> bool

Return true if key is present in the cache (without promotion). Read more
Source§

fn resize(&mut self, new_cap: usize)

Dynamically resize the cache capacity. Read more
Source§

fn is_empty(&self) -> bool

Return true if the cache holds no entries.
Source§

fn get_or_insert(&mut self, key: K, default: impl FnOnce() -> V) -> &V
where K: Clone,

Return &V for key, inserting default() if the key is absent. Read more
Source§

fn values(&self) -> Vec<&V>

Return all live (non-expired) values currently stored in the cache. Read more
Source§

fn warm(&mut self, iter: impl IntoIterator<Item = (K, V)>)

Pre-populate the cache with (key, value) pairs from an iterator. Read more

Auto Trait Implementations§

§

impl<K, V> Freeze for WTinyLfuCache<K, V>

§

impl<K, V> RefUnwindSafe for WTinyLfuCache<K, V>

§

impl<K, V> Send for WTinyLfuCache<K, V>
where K: Send, V: Send,

§

impl<K, V> Sync for WTinyLfuCache<K, V>
where K: Sync, V: Sync,

§

impl<K, V> Unpin for WTinyLfuCache<K, V>
where K: Unpin,

§

impl<K, V> UnsafeUnpin for WTinyLfuCache<K, V>

§

impl<K, V> UnwindSafe for WTinyLfuCache<K, V>

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,

Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.