Skip to main content

EvalEngine

Struct EvalEngine 

Source
pub struct EvalEngine {
    pub config: EvalConfig,
}
Expand description

Main evaluation engine for memory quality assessment.

Fields§

§config: EvalConfig

Configuration.

Implementations§

Source§

impl EvalEngine

Source

pub fn new() -> Self

Creates a new evaluation engine with default configuration.

Source

pub fn with_config(config: EvalConfig) -> Self

Creates a new evaluation engine with custom configuration.

Source

pub fn evaluate( &self, memories: &[Memory], query_results: &[Vec<QuantumMeasurementResult>], identity_patterns: Option<&[HabituatedPattern]>, ) -> Result<EvalReport, EvalError>

Evaluates a collection of memories across all 7 dimensions.

§Parameters
  • memories: The stored memories to evaluate
  • query_results: Recent recall query results for retrieval evaluation
  • identity_patterns: Current habituated patterns from the identity knot
Source

pub fn evaluate_retrieval( &self, query_results: &[Vec<QuantumMeasurementResult>], ) -> Result<DimensionScore, EvalError>

Evaluates retrieval accuracy across query results.

Measures: proportion of queries that returned at least one result above the retrieval threshold.

Source

pub fn evaluate_summarization( &self, memories: &[Memory], ) -> Result<DimensionScore, EvalError>

Evaluates summarization quality by measuring consolidation coverage.

Measures: ratio of semantic-classified memories to total memories. A well-consolidated memory store should have a healthy proportion of semantic (abstracted) vs. raw episodic memories.

Source

pub fn evaluate_isolation( &self, memories: &[Memory], ) -> Result<DimensionScore, EvalError>

Evaluates source isolation quality.

Measures: average isolation score across all memories. High isolation = memories from different sources don’t interfere. Low isolation = source contamination risk.

Source

pub fn evaluate_inference( &self, memories: &[Memory], ) -> Result<DimensionScore, EvalError>

Evaluates inference capability through verifiability distribution.

Measures: proportion of memories at Verified/Durable stage. A memory system with strong inference will have promoted many memories to higher verifiability through reasoning.

Source

pub fn evaluate_reproduction( &self, memories: &[Memory], ) -> Result<DimensionScore, EvalError>

Evaluates reproduction fidelity through procedural memory coverage.

Measures: ratio of procedural-classified memories to total. Procedural memories are the “reproduction” dimension — they encode how to do things, not just what was done.

Source

pub fn evaluate_learning( &self, memories: &[Memory], ) -> Result<DimensionScore, EvalError>

Evaluates learning capability through memory diversity and growth.

Measures: memory class diversity (entropy over class distribution) and the ratio of cross-scope memories (agent vs user vs session).

Source

pub fn evaluate_habituation( &self, patterns: Option<&[HabituatedPattern]>, ) -> Result<DimensionScore, EvalError>

Evaluates habituation through pattern stability analysis.

Measures: proportion of habituated patterns vs. total patterns, and average stability of habituated patterns.

Trait Implementations§

Source§

impl Default for EvalEngine

Source§

fn default() -> Self

Returns the “default value” for a type. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<SS, SP> SupersetOf<SS> for SP
where SS: SubsetOf<SP>,

Source§

fn to_subset(&self) -> Option<SS>

The inverse inclusion map: attempts to construct self from the equivalent element of its superset. Read more
Source§

fn is_in_subset(&self) -> bool

Checks if self is actually part of its subset T (and can be converted to it).
Source§

fn to_subset_unchecked(&self) -> SS

Use with care! Same as self.to_subset but without any property checks. Always succeeds.
Source§

fn from_subset(element: &SS) -> SP

The inclusion map: converts self to the equivalent element of its superset.
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.