Skip to main content

QueryCache

Struct QueryCache 

Source
pub struct QueryCache { /* private fields */ }
Expand description

Thread-safe LRU cache for server-side query results.

Uses parking_lot::RwLock for efficient concurrent access. Read operations that result in a cache hit still require a write lock (to update LRU order and access counters), but the critical section is kept short.

Implementations§

Source§

impl QueryCache

Source

pub fn new( max_entries: usize, default_ttl: Duration, max_value_size: usize, ) -> Self

Create a new QueryCache.

§Arguments
  • max_entries - maximum number of entries the cache may hold.
  • default_ttl - default time-to-live for cached entries.
  • max_value_size - maximum size (in bytes) of a single cached value.
Source

pub fn get(&self, key: &CacheKey) -> Option<Vec<u8>>

Look up a cached result by cache key.

Returns Some(Vec<u8>) if a non-expired entry exists, otherwise None. On a hit the entry is promoted to most-recently-used and the hit counter is incremented. On a miss or expiry the miss counter is incremented.

Source

pub fn put(&self, key: CacheKey, result: Vec<u8>)

Store a query result in the cache using the cache’s default TTL.

If the value exceeds max_value_size it is silently rejected. If the cache is at capacity the least recently used entry is evicted first.

Source

pub fn put_with_ttl(&self, key: CacheKey, result: Vec<u8>, ttl: Duration)

Store a query result with an explicit TTL and optional collection name.

Source

pub fn put_with_options( &self, key: CacheKey, result: Vec<u8>, ttl: Duration, collection: Option<&str>, )

Store a query result with an explicit TTL and collection name.

Source

pub fn invalidate(&self, collection: &str)

Invalidate all entries belonging to the given collection.

This is the primary write-through invalidation hook: when a PUT, DELETE, or UPDATE operation mutates a collection, call this method with the collection name to ensure stale results are never served.

Source

pub fn invalidate_all(&self)

Clear the entire cache.

Source

pub fn stats(&self) -> CacheStatsSnapshot

Return a snapshot of the current cache statistics.

Source

pub fn resize(&self, new_max: usize)

Resize the cache to a new maximum number of entries.

If the new maximum is smaller than the current number of entries the least recently used entries are evicted until the constraint is met.

Source

pub fn len(&self) -> usize

Current number of entries in the cache.

Source

pub fn is_empty(&self) -> bool

Whether the cache is empty.

Source

pub fn total_size_bytes(&self) -> usize

Total bytes of all cached values.

Trait Implementations§

Source§

impl Debug for QueryCache

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> ArchivePointee for T

Source§

type ArchivedMetadata = ()

The archived version of the pointer metadata for this type.
Source§

fn pointer_metadata( _: &<T as ArchivePointee>::ArchivedMetadata, ) -> <T as Pointee>::Metadata

Converts some archived metadata to the pointer metadata for itself.
Source§

impl<'a, T, E> AsTaggedExplicit<'a, E> for T
where T: 'a,

Source§

fn explicit(self, class: Class, tag: u32) -> TaggedParser<'a, Explicit, Self, E>

Source§

impl<'a, T, E> AsTaggedImplicit<'a, E> for T
where T: 'a,

Source§

fn implicit( self, class: Class, constructed: bool, tag: u32, ) -> TaggedParser<'a, Implicit, Self, E>

Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<Input, Output> CastInto<Output> for Input
where Output: CastFrom<Input>,

Source§

fn cast_into(self) -> Output

Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoEither for T

Source§

fn into_either(self, into_left: bool) -> Either<Self, Self>

Converts self into a Left variant of Either<Self, Self> if into_left is true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
where F: FnOnce(&Self) -> bool,

Converts self into a Left variant of Either<Self, Self> if into_left(&self) returns true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

impl<T> IntoRequest<T> for T

Source§

fn into_request(self) -> Request<T>

Wrap the input message T in a tonic::Request
Source§

impl<L> LayerExt<L> for L

Source§

fn named_layer<S>(&self, service: S) -> Layered<<L as Layer<S>>::Service, S>
where L: Layer<S>,

Applies the layer to a service and wraps it in Layered.
Source§

impl<T> LayoutRaw for T

Source§

fn layout_raw(_: <T as Pointee>::Metadata) -> Result<Layout, LayoutError>

Returns the layout of the type.
Source§

impl<T, N1, N2> Niching<NichedOption<T, N1>> for N2
where T: SharedNiching<N1, N2>, N1: Niching<T>, N2: Niching<T>,

Source§

unsafe fn is_niched(niched: *const NichedOption<T, N1>) -> bool

Returns whether the given value has been niched. Read more
Source§

fn resolve_niched(out: Place<NichedOption<T, N1>>)

Writes data to out indicating that a T is niched.
Source§

impl<T> Pointable for T

Source§

const ALIGN: usize

The alignment of pointer.
Source§

type Init = T

The type for initializers.
Source§

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more
Source§

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more
Source§

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more
Source§

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more
Source§

impl<T> Pointee for T

Source§

type Metadata = ()

The metadata type for pointers and references to this type.
Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V

Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more