pub struct EvalEngine {
pub config: EvalConfig,
}Expand description
Main evaluation engine for memory quality assessment.
Fields§
§config: EvalConfigConfiguration.
Implementations§
Source§impl EvalEngine
impl EvalEngine
Sourcepub fn with_config(config: EvalConfig) -> Self
pub fn with_config(config: EvalConfig) -> Self
Creates a new evaluation engine with custom configuration.
Sourcepub fn evaluate(
&self,
memories: &[Memory],
query_results: &[Vec<QuantumMeasurementResult>],
identity_patterns: Option<&[HabituatedPattern]>,
) -> Result<EvalReport, EvalError>
pub fn evaluate( &self, memories: &[Memory], query_results: &[Vec<QuantumMeasurementResult>], identity_patterns: Option<&[HabituatedPattern]>, ) -> Result<EvalReport, EvalError>
Evaluates a collection of memories across all 7 dimensions.
§Parameters
memories: The stored memories to evaluatequery_results: Recent recall query results for retrieval evaluationidentity_patterns: Current habituated patterns from the identity knot
Sourcepub fn evaluate_retrieval(
&self,
query_results: &[Vec<QuantumMeasurementResult>],
) -> Result<DimensionScore, EvalError>
pub fn evaluate_retrieval( &self, query_results: &[Vec<QuantumMeasurementResult>], ) -> Result<DimensionScore, EvalError>
Evaluates retrieval accuracy across query results.
Measures: proportion of queries that returned at least one result above the retrieval threshold.
Sourcepub fn evaluate_summarization(
&self,
memories: &[Memory],
) -> Result<DimensionScore, EvalError>
pub fn evaluate_summarization( &self, memories: &[Memory], ) -> Result<DimensionScore, EvalError>
Evaluates summarization quality by measuring consolidation coverage.
Measures: ratio of semantic-classified memories to total memories. A well-consolidated memory store should have a healthy proportion of semantic (abstracted) vs. raw episodic memories.
Sourcepub fn evaluate_isolation(
&self,
memories: &[Memory],
) -> Result<DimensionScore, EvalError>
pub fn evaluate_isolation( &self, memories: &[Memory], ) -> Result<DimensionScore, EvalError>
Evaluates source isolation quality.
Measures: average isolation score across all memories. High isolation = memories from different sources don’t interfere. Low isolation = source contamination risk.
Sourcepub fn evaluate_inference(
&self,
memories: &[Memory],
) -> Result<DimensionScore, EvalError>
pub fn evaluate_inference( &self, memories: &[Memory], ) -> Result<DimensionScore, EvalError>
Evaluates inference capability through verifiability distribution.
Measures: proportion of memories at Verified/Durable stage. A memory system with strong inference will have promoted many memories to higher verifiability through reasoning.
Sourcepub fn evaluate_reproduction(
&self,
memories: &[Memory],
) -> Result<DimensionScore, EvalError>
pub fn evaluate_reproduction( &self, memories: &[Memory], ) -> Result<DimensionScore, EvalError>
Evaluates reproduction fidelity through procedural memory coverage.
Measures: ratio of procedural-classified memories to total. Procedural memories are the “reproduction” dimension — they encode how to do things, not just what was done.
Sourcepub fn evaluate_learning(
&self,
memories: &[Memory],
) -> Result<DimensionScore, EvalError>
pub fn evaluate_learning( &self, memories: &[Memory], ) -> Result<DimensionScore, EvalError>
Evaluates learning capability through memory diversity and growth.
Measures: memory class diversity (entropy over class distribution) and the ratio of cross-scope memories (agent vs user vs session).
Sourcepub fn evaluate_habituation(
&self,
patterns: Option<&[HabituatedPattern]>,
) -> Result<DimensionScore, EvalError>
pub fn evaluate_habituation( &self, patterns: Option<&[HabituatedPattern]>, ) -> Result<DimensionScore, EvalError>
Evaluates habituation through pattern stability analysis.
Measures: proportion of habituated patterns vs. total patterns, and average stability of habituated patterns.
Trait Implementations§
Auto Trait Implementations§
impl Freeze for EvalEngine
impl RefUnwindSafe for EvalEngine
impl Send for EvalEngine
impl Sync for EvalEngine
impl Unpin for EvalEngine
impl UnsafeUnpin for EvalEngine
impl UnwindSafe for EvalEngine
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Source§impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
Source§fn to_subset(&self) -> Option<SS>
fn to_subset(&self) -> Option<SS>
self from the equivalent element of its
superset. Read moreSource§fn is_in_subset(&self) -> bool
fn is_in_subset(&self) -> bool
self is actually part of its subset T (and can be converted to it).Source§fn to_subset_unchecked(&self) -> SS
fn to_subset_unchecked(&self) -> SS
self.to_subset but without any property checks. Always succeeds.Source§fn from_subset(element: &SS) -> SP
fn from_subset(element: &SS) -> SP
self to the equivalent element of its superset.