pub struct SemanticCacheConfig {
pub similarity_threshold: f32,
pub default_ttl_ms: u64,
pub max_entries: usize,
pub namespace: String,
}Expand description
Compile-time tuneables for a cache instance.
Fields§
§similarity_threshold: f32Cosine similarity threshold above which a candidate counts as a hit. Typical values: 0.90–0.98.
default_ttl_ms: u64Default TTL applied to freshly-inserted entries. 0 =
entries never expire. Callers can still pass a per-insert
override.
max_entries: usizeMaximum live entries. Oldest inserted entry is evicted once
this limit is reached. 0 = unbounded.
namespace: StringPersistence namespace suffix. Allows multiple named caches
to share one MlPersistence backend without colliding.
Trait Implementations§
Source§impl Clone for SemanticCacheConfig
impl Clone for SemanticCacheConfig
Source§fn clone(&self) -> SemanticCacheConfig
fn clone(&self) -> SemanticCacheConfig
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for SemanticCacheConfig
impl Debug for SemanticCacheConfig
Auto Trait Implementations§
impl Freeze for SemanticCacheConfig
impl RefUnwindSafe for SemanticCacheConfig
impl Send for SemanticCacheConfig
impl Sync for SemanticCacheConfig
impl Unpin for SemanticCacheConfig
impl UnsafeUnpin for SemanticCacheConfig
impl UnwindSafe for SemanticCacheConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
Source§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
Wrap the input message
T in a tonic::Request