Struct CompactingMemory 

pub struct CompactingMemory<M, P, C: Compactor> { /* private fields */ }

Prepends a rolling summary of demoted history to the policy’s retained window. New evictions are compacted with the previous artifact as carry-over. The summary is outside the policy budget; callers needing a bounded prompt must also bound the compactor’s artifact.

Only one compaction per tracked conversation runs at a time. Concurrent loads return the previous summary and retained window immediately. Errors reach only the compacting caller; unchanged watermarks allow later loads to retry.

Summaries and watermarks are process-local. Restarts or discarded state cause recompaction; compactors with side effects must tolerate repeated input.

use rig_memory::{
    CompactingMemory, InMemoryConversationMemory, SlidingWindowMemory,
    TemplateCompactor,
};

let memory = CompactingMemory::new(
    InMemoryConversationMemory::new(),
    SlidingWindowMemory::last_messages(20),
    TemplateCompactor::new(),
);

Implementations

impl<M, P, C: Compactor> CompactingMemory<M, P, C>

pub fn new(inner: M, policy: P, compactor: C) -> Self

Wrap inner so every load runs through policy and demoted messages are summarised by compactor.

impl<M, P, C: Compactor> CompactingMemory<M, P, C>

pub fn inner(&self) -> &M

Return a reference to the wrapped backend.

pub fn policy(&self) -> &P

Return a reference to the wrapped policy.

pub fn compactor(&self) -> &C

Return a reference to the third component.

pub fn into_inner(self) -> (M, P, C)

Consume the wrapper and return its three components.

pub fn forget(&self, conversation_id: &ConversationId)

Drop the in-process state for conversation_id.

Entries otherwise persist for the wrapper’s lifetime. Does nothing if the state lock is poisoned. In-flight work is not cancelled.

pub fn tracked_conversations(&self) -> usize

Number of conversations currently tracked in the state map. Useful for telemetry and leak detection. Returns 0 if the internal state lock is poisoned.

Trait Implementations

impl<M, P, C> ConversationMemory for CompactingMemory<M, P, C>

where M: ConversationMemory, P: MemoryPolicy, C: Compactor,

fn load<'a>( &'a self, conversation_id: &'a ConversationId, ) -> WasmBoxedFuture<'a, Result<Vec<Message>, MemoryError>>

Load the full conversation history for conversation_id.

fn append<'a>( &'a self, conversation_id: &'a ConversationId, messages: Vec<Message>, ) -> WasmBoxedFuture<'a, Result<(), MemoryError>>

Append messages to the conversation identified by conversation_id.

fn clear<'a>( &'a self, conversation_id: &'a ConversationId, ) -> WasmBoxedFuture<'a, Result<(), MemoryError>>

Remove all stored messages for conversation_id.

impl<M, P, C: Compactor> Debug for CompactingMemory<M, P, C>

where M: Debug, P: Debug,

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.