Skip to main content

CachePolicy

Enum CachePolicy 

Source
pub enum CachePolicy {
    NoCache,
    Ttl {
        ttl_ms: u64,
    },
    StaleWhileRevalidate {
        ttl_ms: u64,
        stale_ms: u64,
    },
}
Available on crate feature core only.
Expand description

How cached data is treated when a query is accessed.

  • NoCache: Always fetch fresh data.
  • Ttl: Use cached data if fresh (within TTL).
  • StaleWhileRevalidate: Return stale data immediately while fetching fresh data in the background.

Variants§

§

NoCache

Never cache — always fetch fresh data.

§

Ttl

Cache with a time-to-live. Data is considered fresh within the TTL.

Note: ttl_ms should be greater than zero. A ttl_ms of 0 is equivalent to NoCache for all practical purposes — data is only “fresh” at the exact instant it is stored, so every begin_request call triggers a new fetch. This is not validated at runtime in release builds, but a debug_assert will fire in debug builds if ttl_ms is zero.

Fields

§ttl_ms: u64
§

StaleWhileRevalidate

Return stale data immediately while revalidating in the background.

Data within ttl_ms is served as a fresh cache hit (no refetch). Data between ttl_ms and ttl_ms + stale_ms is served as stale data and a background revalidation is triggered. After ttl_ms + stale_ms, data is considered expired and a normal fetch is performed (no stale data served).

Note: stale_ms should be greater than zero. Setting stale_ms to 0 effectively disables the stale-while-revalidate feature, degenerating to pure TTL behavior (the stale window is an empty set). Both ttl_ms and stale_ms should be greater than zero. This is not validated at runtime in release builds, but debug_asserts will fire in debug builds if either value is zero.

Fields

§ttl_ms: u64
§stale_ms: u64

Implementations§

Source§

impl CachePolicy

Source

pub fn label(self) -> String

Human-readable label.

Sub-second values are shown with millisecond precision (e.g. “500ms”) rather than truncating to “0s” via integer division.

Thin wrapper around the Display impl that allocates a String. Prefer format!("{policy}") or writing directly to a formatter to avoid the heap allocation for log/diagnostic callers.

Source

pub fn can_short_circuit(self) -> bool

Whether this policy can short-circuit (return cached data without fetching).

Returns true for Ttl and StaleWhileRevalidate since both can serve cached data when it is fresh (within the TTL window). The actual freshness check is done separately in is_fresh.

Source

pub fn can_serve_stale(self) -> bool

Whether this policy allows serving stale data while revalidating.

Source

pub fn ttl_ms(self) -> Option<u64>

The TTL in milliseconds, if applicable.

Source

pub fn stale_ms(self) -> Option<u64>

The stale-while-revalidate window in milliseconds beyond TTL.

Returns None for policies that are not StaleWhileRevalidate.

Source

pub fn total_valid_ms(self) -> Option<u64>

Total valid window (TTL + stale) in milliseconds.

This is the maximum age at which data can still be served under this policy. For Ttl, this equals ttl_ms. For StaleWhileRevalidate, it equals ttl_ms + stale_ms. Returns None for NoCache.

On overflow (extremely large ttl_ms + stale_ms), saturates to u64::MAX, effectively treating the data as indefinitely valid.

Source

pub fn is_fresh(self, age_ms: u64) -> bool

Whether the data is fresh (within the TTL window).

Returns false if the policy has no TTL or the data age exceeds TTL.

Source

pub fn is_stale_but_serveable(self, age_ms: u64) -> bool

Whether the data is stale but still within the stale-while-revalidate window.

Data is “stale-but-serveable” when:

  • The policy is StaleWhileRevalidate
  • Data age is past TTL but within ttl_ms + stale_ms
Source

pub fn is_expired(self, age_ms: u64) -> bool

Whether the data is expired (past the total valid window).

Returns true if the data age exceeds the total valid window for this policy.

Trait Implementations§

Source§

impl Clone for CachePolicy

Source§

fn clone(&self) -> CachePolicy

Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Copy for CachePolicy

Source§

impl Debug for CachePolicy

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl Default for CachePolicy

Source§

fn default() -> Self

Returns the “default value” for a type. Read more
Source§

impl<'de> Deserialize<'de> for CachePolicy

Source§

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>
where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer. Read more
Source§

impl Display for CachePolicy

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Reproduces the exact strings produced by CachePolicy::label.

The duration formatting is inlined here (mirroring [format_duration]) so that no intermediate String is allocated when writing to a formatter — the whole point of the Display impl.

Source§

impl Eq for CachePolicy

Source§

impl PartialEq for CachePolicy

Source§

fn eq(&self, other: &CachePolicy) -> bool

Equality operator ==. Read more
1.0.0 (const: unstable) · Source§

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=. Read more
Source§

impl Serialize for CachePolicy

Source§

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>
where __S: Serializer,

Serialize this value into the given Serde serializer. Read more
Source§

impl StructuralPartialEq for CachePolicy

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> DeserializeOwned for T
where T: for<'de> Deserialize<'de>,

Source§

impl<T> Downcast for T
where T: Any,

Source§

fn into_any(self: Box<T>) -> Box<dyn Any>

Convert Box<dyn Trait> (where Trait: Downcast) to Box<dyn Any>. Box<dyn Any> can then be further downcast into Box<ConcreteType> where ConcreteType implements Trait.
Source§

fn into_any_rc(self: Rc<T>) -> Rc<dyn Any>

Convert Rc<Trait> (where Trait: Downcast) to Rc<Any>. Rc<Any> can then be further downcast into Rc<ConcreteType> where ConcreteType implements Trait.
Source§

fn as_any(&self) -> &(dyn Any + 'static)

Convert &Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot generate &Any’s vtable from &Trait’s.
Source§

fn as_any_mut(&mut self) -> &mut (dyn Any + 'static)

Convert &mut Trait (where Trait: Downcast) to &Any. This is needed since Rust cannot generate &mut Any’s vtable from &mut Trait’s.
Source§

impl<T> DowncastSync for T
where T: Any + Send + Sync,

Source§

fn into_any_arc(self: Arc<T>) -> Arc<dyn Any + Send + Sync>

Convert Arc<Trait> (where Trait: Downcast) to Arc<Any>. Arc<Any> can then be further downcast into Arc<ConcreteType> where ConcreteType implements Trait.
Source§

impl<T> DynClone for T
where T: Clone,

Source§

fn __clone_box(&self, _: Private) -> *mut ()

Source§

impl<Q, K> Equivalent<K> for Q
where Q: Eq + ?Sized, K: Borrow<Q> + ?Sized,

Source§

fn equivalent(&self, key: &K) -> bool

Checks if this value is equivalent to the given key. Read more
Source§

impl<Q, K> Equivalent<K> for Q
where Q: Eq + ?Sized, K: Borrow<Q> + ?Sized,

Source§

fn equivalent(&self, key: &K) -> bool

Compare self to key and return true if they are equal.
Source§

impl<Q, K> Equivalent<K> for Q
where Q: Eq + ?Sized, K: Borrow<Q> + ?Sized,

Source§

fn equivalent(&self, key: &K) -> bool

Checks if this value is equivalent to the given key. Read more
Source§

impl<Q, K> Equivalent<K> for Q
where Q: Eq + ?Sized, K: Borrow<Q> + ?Sized,

Source§

fn equivalent(&self, key: &K) -> bool

Checks if this value is equivalent to the given key. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoEither for T

Source§

fn into_either(self, into_left: bool) -> Either<Self, Self>

Converts self into a Left variant of Either<Self, Self> if into_left is true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
where F: FnOnce(&Self) -> bool,

Converts self into a Left variant of Either<Self, Self> if into_left(&self) returns true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

impl<T> NoneValue for T
where T: Default,

Source§

type NoneType = T

Source§

fn null_value() -> T

The none-equivalent value.
Source§

impl<T> Pointable for T

Source§

const ALIGN: usize

The alignment of pointer.
Source§

type Init = T

The type for initializers.
Source§

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more
Source§

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more
Source§

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more
Source§

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more
Source§

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,

Source§

impl<R, P> ReadPrimitive<R> for P
where R: Read + ReadEndian<P>, P: Default,

Source§

fn read_from_little_endian(read: &mut R) -> Result<Self, Error>

Read this value from the supplied reader. Same as ReadEndian::read_from_little_endian().
Source§

fn read_from_big_endian(read: &mut R) -> Result<Self, Error>

Read this value from the supplied reader. Same as ReadEndian::read_from_big_endian().
Source§

fn read_from_native_endian(read: &mut R) -> Result<Self, Error>

Read this value from the supplied reader. Same as ReadEndian::read_from_native_endian().
Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T> Serialize for T
where T: Serialize + ?Sized,

Source§

fn erased_serialize(&self, serializer: &mut dyn Serializer) -> Result<(), Error>

Source§

fn do_erased_serialize( &self, serializer: &mut dyn Serializer, ) -> Result<(), ErrorImpl>

Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T> ToSmolStr for T
where T: Display + ?Sized,

Source§

impl<T> ToString for T
where T: Display + ?Sized,

Source§

fn to_string(&self) -> String

Converts the given value to a String. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = !

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, !>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V

Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more