Cache

Struct Cache 

Source
pub struct Cache<DC>
where DC: DataController, DC::Key: Send + Sync + 'static, DC::Error: Send + Sync + 'static,
{ /* private fields */ }
Expand description

This is where all the magic happens!

let controller = MyDataController::new(host, port);
let cache = Cache::builder()
    .data_controller(controller)
    .max_updates(1000)
    .max_capacity(100_000)
   .flush_interval(Duration::from_secs(10))
   .build();

// The key type is defined by the data controller implementation of DataController.
cache.entry(key).await?
    .and_try_compute_with(|entry| async {
       let record = if let Some(entry) = entry {
           modify(entry.into_value()).await?
       }
       else {
          create_new().await?
       };

       Ok(Op::Put(record))
    })
    .await?;

Implementations§

Source§

impl<DC> Cache<DC>
where DC: DataController, DC::Key: Send + Sync + 'static, DC::Error: Send + Sync + 'static,

Source

pub fn error(&self) -> Option<Arc<DC::Error>>

The last error that occurred within the background task. If set, any subsequent call to a public method operating on the cache object will return this error.

Source

pub fn clear_error(&self) -> Option<Arc<DC::Error>>

Clears and returns the last error or None.

Source

pub fn data_controller(&self) -> Arc<DC>

The data controller object.

Source

pub fn max_updates(&self) -> u64

The maximum size of the updates pool. This not a hard limit but a threshold that triggers automatic flushing by the background task.

Defaults to 100.

Source

pub fn max_capacity(&self) -> u64

The maximum cache capacity. This is a hard limit on the number of key entries (not records). See the crate documentation for details.

Defaults to 10000.

Source

pub fn flush_interval(&self) -> Duration

The delay between two consecutive flushes. If a flush was manually requested then the timer is reset.

Source

pub fn set_flush_interval(&mut self, value: Duration) -> Duration

Change the flush interval.

Source

pub fn monitor_tick_duration(&self) -> u64

The period of time between two consecutive checks of the cache state by the background task.

Source

pub fn builder() -> CacheBuilder<DC>

Implement builder pattern for Cache.

Source§

impl<DC> Cache<DC>
where DC: DataController,

Source

pub fn name(&self) -> String

Cache name. Most useful for debugging and logging.

Source

pub async fn entry( &self, key: DC::Key, ) -> Result<EntryKeySelector<DC>, Arc<DC::Error>>

Returns an object that represents a key in the cache.

Source

pub async fn get( &self, key: &DC::Key, ) -> Result<Option<DC::Value>, Arc<DC::Error>>

Try to get a value from the cache by its key. If the value is not present, the controller attempts to fetch it via the data controller. Returns None if such a key does not exist.

Source

pub async fn insert( &self, value: DC::Value, ) -> Result<Option<DC::Value>, Arc<DC::Error>>

Insert a value into the cache. This operation triggers the on_new data controller chain of events even in case there is already a value present for the same key.

Source

pub async fn delete( &self, key: &DC::Key, ) -> Result<Option<DC::Value>, Arc<DC::Error>>

Delete a value from the cache by its key. If the value is not cached yet, it will be fetched from the backend first. This behavior is subject to further optimization. In most cases, however, this should not be a problem because if one knows what to delete without inspecting it first or using it in other ways, then it would be more efficient to delete directly in the backend.

Source

pub async fn invalidate(&self, key: &DC::Key) -> Result<(), Arc<DC::Error>>

Invalidate a key in the cache. A secondary key is invalidated by removing it from the cache, while a primary key is invalidated by removing it and all its secondary keys from the cache.

Source

pub async fn flush_many_raw( &self, keys: Vec<DC::Key>, ) -> Result<usize, DC::Error>

Low-level immediate flush operation that requires a list of keys to flush. It does not check for error generated by the background task.

Source

pub async fn flush_raw(&self) -> Result<usize, DC::Error>

The same as the flush method but does not check for error that may have occurred in the background task.

Source

pub async fn flush(&self) -> Result<usize, Arc<DC::Error>>

Immediately flushes all updates in the pool but will do nothing and immediately error out if the background task has encountered an error.

Source

pub async fn soft_flush(&self) -> Result<(), Arc<DC::Error>>

Initiates a flush via the background task.

This method does not wait for the flush to complete; it returns immediately. If the background task has previously encountered an error, this method will do nothing and return that error.

Source

pub async fn flush_one(&self, key: &DC::Key) -> Result<usize, Arc<DC::Error>>

Flushes a single key in the cache. Although the operation itself is inefficient from the caching perspective, it is useful in a multi-cache environment where values in one backend refer to values in another. For example, when there is a foreign key relationship between two tables in a database, a dependent record cannot be written into the backend until its dependency is written first.

This method is most useful when invoked by an observer.

Does nothing and returns an error if the background task has encountered an error.

Source

pub async fn close(&self) -> Result<(), Arc<DC::Error>>

Prepares the cache for shutdown. This method will notify the background task to stop and flush all updates. It will block until the task is finished.

The method is mandatory to be called before the cache is dropped to ensure that no data is lost.

Will do nothing and return an error if the background task has encountered an error.

Source

pub fn is_shut_down(&self) -> bool

Returns the shutdown status of the cache.

Trait Implementations§

Source§

impl<DC> Debug for Cache<DC>
where DC: DataController,

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl<DC> Parent for Cache<DC>
where DC: DataController, DC::Key: Send + Sync + 'static, DC::Error: Send + Sync + 'static,

Source§

type WeakSelf = Weak<Cache<DC>>

Weak ref-count type for the parent to hold a reference to itself.
Source§

fn __fxplus_myself_downgrade(&self) -> Weak<Self>

Source§

impl<DC> FXStruct for Cache<DC>
where DC: DataController, DC::Key: Send + Sync + 'static, DC::Error: Send + Sync + 'static,

Auto Trait Implementations§

§

impl<DC> !Freeze for Cache<DC>

§

impl<DC> !RefUnwindSafe for Cache<DC>

§

impl<DC> Send for Cache<DC>

§

impl<DC> Sync for Cache<DC>

§

impl<DC> Unpin for Cache<DC>
where <DC as DataController>::Key: Unpin,

§

impl<DC> !UnwindSafe for Cache<DC>

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T, U> FXInto<U> for T
where U: FXFrom<T>,

Source§

fn fx_into(self) -> U

Source§

impl<T, U> FXTryInto<U> for T
where U: FXTryFrom<T>,

Source§

type Error = <U as FXTryFrom<T>>::Error

Source§

fn fx_try_into(self) -> Result<U, <T as FXTryInto<U>>::Error>

Source§

impl<T> Fake for T

Source§

fn fake<U>(&self) -> U
where Self: FakeBase<U>,

Source§

fn fake_with_rng<U, R>(&self, rng: &mut R) -> U
where R: Rng + ?Sized, Self: FakeBase<U>,

Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> FutureExt for T

Source§

fn with_context(self, otel_cx: Context) -> WithContext<Self>

Attaches the provided Context to this type, returning a WithContext wrapper. Read more
Source§

fn with_current_context(self) -> WithContext<Self>

Attaches the current Context to this type, returning a WithContext wrapper. Read more
Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoEither for T

Source§

fn into_either(self, into_left: bool) -> Either<Self, Self>

Converts self into a Left variant of Either<Self, Self> if into_left is true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
where F: FnOnce(&Self) -> bool,

Converts self into a Left variant of Either<Self, Self> if into_left(&self) returns true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

impl<T> IntoRequest<T> for T

Source§

fn into_request(self) -> Request<T>

Wrap the input message T in a tonic::Request
Source§

impl<L> LayerExt<L> for L

Source§

fn named_layer<S>(&self, service: S) -> Layered<<L as Layer<S>>::Service, S>
where L: Layer<S>,

Applies the layer to a service and wraps it in Layered.
Source§

impl<T> Pointable for T

Source§

const ALIGN: usize

The alignment of pointer.
Source§

type Init = T

The type for initializers.
Source§

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more
Source§

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more
Source§

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more
Source§

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more
Source§

impl<T> PolicyExt for T
where T: ?Sized,

Source§

fn and<P, B, E>(self, other: P) -> And<T, P>
where T: Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow only if self and other return Action::Follow. Read more
Source§

fn or<P, B, E>(self, other: P) -> Or<T, P>
where T: Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow if either self or other returns Action::Follow. Read more
Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<SS, SP> SupersetOf<SS> for SP
where SS: SubsetOf<SP>,

Source§

fn to_subset(&self) -> Option<SS>

The inverse inclusion map: attempts to construct self from the equivalent element of its superset. Read more
Source§

fn is_in_subset(&self) -> bool

Checks if self is actually part of its subset T (and can be converted to it).
Source§

fn to_subset_unchecked(&self) -> SS

Use with care! Same as self.to_subset but without any property checks. Always succeeds.
Source§

fn from_subset(element: &SS) -> SP

The inclusion map: converts self to the equivalent element of its superset.
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V

Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

impl<T> ErasedDestructor for T
where T: 'static,