Skip to main content

ParallelReadPolicy

Struct ParallelReadPolicy 

Source
pub struct ParallelReadPolicy;
Expand description

Parallel read policy: Query both L1 and L2 in parallel, prefer freshest data (by TTL).

This strategy provides:

  • Freshness guarantee (returns data with longest remaining TTL)
  • Cache warming (keeps both layers hot)
  • Observability into both layer performance
  • Natural cache coherency (prefers recently updated data)

§Behavior

  1. Start both read_l1(key) and read_l2(key) in parallel
  2. Wait for both to complete
  3. Compare TTLs and prefer the response with longest remaining TTL
  4. Fall back to any available value if one layer misses/errors

§TTL Comparison Rules

When both L1 and L2 have data:

  • Compare remaining TTLs using CacheValue::ttl()
  • Prefer response with longer TTL (fresher data)
  • If one has no expiry (None TTL), prefer it (infinite freshness)
  • If TTLs are equal, prefer L1 (tie-breaker)
  • If both have no expiry, prefer L1 (tie-breaker)

§Tradeoffs

  • Pros: Freshness guarantee, handles L1/L2 consistency naturally, production-viable
  • Cons: 2x backend load, latency limited by slower backend

§Use Cases

  • Production systems where data freshness is critical
  • Multi-region setups where L2 may get updated first
  • Cache warming while ensuring freshest data
  • Validating L1/L2 consistency
  • Monitoring both layer health

§Note

Unlike RaceReadPolicy, this policy always waits for both backends to complete, making it slower but providing freshness guarantees and better observability.

Implementations§

Source§

impl ParallelReadPolicy

Source

pub fn new() -> Self

Create a new parallel read policy.

Trait Implementations§

Source§

impl Clone for ParallelReadPolicy

Source§

fn clone(&self) -> ParallelReadPolicy

Returns a duplicate of the value. Read more
1.0.0 · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl CompositionReadPolicy for ParallelReadPolicy

Source§

fn execute_with<'life0, 'life1, 'async_trait, T, E, F1, F2, Fut1, Fut2, O>( &'life0 self, key: CacheKey, read_l1: F1, read_l2: F2, _offload: &'life1 O, ) -> Pin<Box<dyn Future<Output = Result<ReadResult<T>, E>> + Send + 'async_trait>>
where T: Send + 'static + 'async_trait, E: Send + Debug + 'static + 'async_trait, F1: FnOnce(CacheKey) -> Fut1 + Send + 'async_trait, F2: FnOnce(CacheKey) -> Fut2 + Send + 'async_trait, Fut1: Future<Output = (Result<Option<CacheValue<T>>, E>, BoxContext)> + Send + 'static + 'async_trait, Fut2: Future<Output = (Result<Option<CacheValue<T>>, E>, BoxContext)> + Send + 'static + 'async_trait, O: Offload<'static> + 'async_trait, Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Execute a read operation with custom read closures for each layer. Read more
Source§

impl Debug for ParallelReadPolicy

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl Default for ParallelReadPolicy

Source§

fn default() -> ParallelReadPolicy

Returns the “default value” for a type. Read more
Source§

impl Copy for ParallelReadPolicy

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> ArchivePointee for T

Source§

type ArchivedMetadata = ()

The archived version of the pointer metadata for this type.
Source§

fn pointer_metadata( _: &<T as ArchivePointee>::ArchivedMetadata, ) -> <T as Pointee>::Metadata

Converts some archived metadata to the pointer metadata for itself.
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> LayoutRaw for T

Source§

fn layout_raw(_: <T as Pointee>::Metadata) -> Result<Layout, LayoutError>

Returns the layout of the type.
Source§

impl<T, N1, N2> Niching<NichedOption<T, N1>> for N2
where T: SharedNiching<N1, N2>, N1: Niching<T>, N2: Niching<T>,

Source§

unsafe fn is_niched(niched: *const NichedOption<T, N1>) -> bool

Returns whether the given value has been niched. Read more
Source§

fn resolve_niched(out: Place<NichedOption<T, N1>>)

Writes data to out indicating that a T is niched.
Source§

impl<T> Pointee for T

Source§

type Metadata = ()

The metadata type for pointers and references to this type.
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more