pub struct ParallelReadPolicy;Expand description
Parallel read policy: Query both L1 and L2 in parallel, prefer freshest data (by TTL).
This strategy provides:
- Freshness guarantee (returns data with longest remaining TTL)
- Cache warming (keeps both layers hot)
- Observability into both layer performance
- Natural cache coherency (prefers recently updated data)
§Behavior
- Start both
read_l1(key)andread_l2(key)in parallel - Wait for both to complete
- Compare TTLs and prefer the response with longest remaining TTL
- Fall back to any available value if one layer misses/errors
§TTL Comparison Rules
When both L1 and L2 have data:
- Compare remaining TTLs using
CacheValue::ttl() - Prefer response with longer TTL (fresher data)
- If one has no expiry (
NoneTTL), prefer it (infinite freshness) - If TTLs are equal, prefer L1 (tie-breaker)
- If both have no expiry, prefer L1 (tie-breaker)
§Tradeoffs
- Pros: Freshness guarantee, handles L1/L2 consistency naturally, production-viable
- Cons: 2x backend load, latency limited by slower backend
§Use Cases
- Production systems where data freshness is critical
- Multi-region setups where L2 may get updated first
- Cache warming while ensuring freshest data
- Validating L1/L2 consistency
- Monitoring both layer health
§Note
Unlike RaceReadPolicy, this policy always waits for both backends to complete,
making it slower but providing freshness guarantees and better observability.
Implementations§
Trait Implementations§
Source§impl Clone for ParallelReadPolicy
impl Clone for ParallelReadPolicy
Source§fn clone(&self) -> ParallelReadPolicy
fn clone(&self) -> ParallelReadPolicy
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl CompositionReadPolicy for ParallelReadPolicy
impl CompositionReadPolicy for ParallelReadPolicy
Source§fn execute_with<'life0, 'life1, 'async_trait, T, E, F1, F2, Fut1, Fut2, O>(
&'life0 self,
key: CacheKey,
read_l1: F1,
read_l2: F2,
_offload: &'life1 O,
) -> Pin<Box<dyn Future<Output = Result<ReadResult<T>, E>> + Send + 'async_trait>>where
T: Send + 'static + 'async_trait,
E: Send + Debug + 'static + 'async_trait,
F1: FnOnce(CacheKey) -> Fut1 + Send + 'async_trait,
F2: FnOnce(CacheKey) -> Fut2 + Send + 'async_trait,
Fut1: Future<Output = (Result<Option<CacheValue<T>>, E>, BoxContext)> + Send + 'static + 'async_trait,
Fut2: Future<Output = (Result<Option<CacheValue<T>>, E>, BoxContext)> + Send + 'static + 'async_trait,
O: Offload<'static> + 'async_trait,
Self: 'async_trait,
'life0: 'async_trait,
'life1: 'async_trait,
fn execute_with<'life0, 'life1, 'async_trait, T, E, F1, F2, Fut1, Fut2, O>(
&'life0 self,
key: CacheKey,
read_l1: F1,
read_l2: F2,
_offload: &'life1 O,
) -> Pin<Box<dyn Future<Output = Result<ReadResult<T>, E>> + Send + 'async_trait>>where
T: Send + 'static + 'async_trait,
E: Send + Debug + 'static + 'async_trait,
F1: FnOnce(CacheKey) -> Fut1 + Send + 'async_trait,
F2: FnOnce(CacheKey) -> Fut2 + Send + 'async_trait,
Fut1: Future<Output = (Result<Option<CacheValue<T>>, E>, BoxContext)> + Send + 'static + 'async_trait,
Fut2: Future<Output = (Result<Option<CacheValue<T>>, E>, BoxContext)> + Send + 'static + 'async_trait,
O: Offload<'static> + 'async_trait,
Self: 'async_trait,
'life0: 'async_trait,
'life1: 'async_trait,
Execute a read operation with custom read closures for each layer. Read more
Source§impl Debug for ParallelReadPolicy
impl Debug for ParallelReadPolicy
Source§impl Default for ParallelReadPolicy
impl Default for ParallelReadPolicy
Source§fn default() -> ParallelReadPolicy
fn default() -> ParallelReadPolicy
Returns the “default value” for a type. Read more
impl Copy for ParallelReadPolicy
Auto Trait Implementations§
impl Freeze for ParallelReadPolicy
impl RefUnwindSafe for ParallelReadPolicy
impl Send for ParallelReadPolicy
impl Sync for ParallelReadPolicy
impl Unpin for ParallelReadPolicy
impl UnwindSafe for ParallelReadPolicy
Blanket Implementations§
Source§impl<T> ArchivePointee for T
impl<T> ArchivePointee for T
Source§type ArchivedMetadata = ()
type ArchivedMetadata = ()
The archived version of the pointer metadata for this type.
Source§fn pointer_metadata(
_: &<T as ArchivePointee>::ArchivedMetadata,
) -> <T as Pointee>::Metadata
fn pointer_metadata( _: &<T as ArchivePointee>::ArchivedMetadata, ) -> <T as Pointee>::Metadata
Converts some archived metadata to the pointer metadata for itself.
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> LayoutRaw for T
impl<T> LayoutRaw for T
Source§fn layout_raw(_: <T as Pointee>::Metadata) -> Result<Layout, LayoutError>
fn layout_raw(_: <T as Pointee>::Metadata) -> Result<Layout, LayoutError>
Returns the layout of the type.
Source§impl<T, N1, N2> Niching<NichedOption<T, N1>> for N2
impl<T, N1, N2> Niching<NichedOption<T, N1>> for N2
Source§unsafe fn is_niched(niched: *const NichedOption<T, N1>) -> bool
unsafe fn is_niched(niched: *const NichedOption<T, N1>) -> bool
Returns whether the given value has been niched. Read more
Source§fn resolve_niched(out: Place<NichedOption<T, N1>>)
fn resolve_niched(out: Place<NichedOption<T, N1>>)
Writes data to
out indicating that a T is niched.