pub struct L3Config {
pub enabled: bool,
pub similarity_threshold: f32,
pub max_entries: usize,
pub ttl: Duration,
pub embedding_endpoint: String,
pub embedding_model: String,
pub embedding_dim: usize,
}Expand description
L3 semantic cache configuration
Fields§
§enabled: boolEnable L3 semantic cache
similarity_threshold: f32Cosine similarity threshold for cache hits
max_entries: usizeMaximum entries in semantic cache
ttl: DurationTime-to-live for semantic cache entries
embedding_endpoint: StringOllama endpoint for embeddings
embedding_model: StringEmbedding model name
embedding_dim: usizeEmbedding dimension
Trait Implementations§
Auto Trait Implementations§
impl Freeze for L3Config
impl RefUnwindSafe for L3Config
impl Send for L3Config
impl Sync for L3Config
impl Unpin for L3Config
impl UnsafeUnpin for L3Config
impl UnwindSafe for L3Config
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more