reflex-cache 0.2.2

Episodic memory and high-speed semantic cache for LLM responses
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20

//! L3 verification via cross-encoder reranking.
//!
//! Given a query and candidate `CacheEntry`s, score them with [`Reranker`](crate::embedding::Reranker)
//! and decide whether the best candidate is above the configured threshold.
//!
//! Note: [`CrossEncoderScorer`] treats `CacheEntry::payload_blob` as UTF-8 candidate text.

/// Scoring/verification errors.
pub mod error;
/// Cross-encoder scorer.
pub mod scorer;
/// Scoring result types.
pub mod types;

#[cfg(test)]
mod tests;

pub use error::ScoringError;
pub use scorer::CrossEncoderScorer;
pub use types::{VerificationResult, VerifiedCandidate};