Skip to main content

MemoryGuide

Struct MemoryGuide 

Source
pub struct MemoryGuide { /* private fields */ }
Expand description

Guide that recalls relevant prior memories and injects them into ctx.guides as a Block::Text for the model to see.

Two recall points:

  • apply (session start): one-shot recall using ctx.task.description as the query. Always fires.
  • apply_before_iter (every model turn): re-recalls using the last user message as query, replacing the previous recall block. Lets the recall track topic drift mid-session. No-op when there’s no user message in history (the very first iteration uses the apply recall).

Filters (chainable builders, post-recall):

  • with_top_k(k) — number of candidates to fetch from Memory::recall. Default 5.
  • with_min_score(s) — drop entries whose recomputed normalised keyword overlap with the query is below s. Default 0.0 (no filter). Score = (query_tokens ∩ entry_tokens).len() / query_tokens.len().
  • with_required_tags(tags) — drop entries that don’t have ALL these tags. Default empty (no filter).
  • with_excluded_tags(tags) — drop entries that have ANY of these tags. Default empty.

When filters are tight, we over-fetch top_k * 3 candidates so there’s room to drop without starving the output.

Implementations§

Source§

impl MemoryGuide

Source

pub fn new(memory: Arc<dyn Memory>) -> Self

Construct a guide that recalls up to 5 entries per session.

Source

pub fn with_top_k(self, k: usize) -> Self

Override the number of memories recalled per session. Pick small — every recalled line spends prompt tokens.

Source

pub fn with_min_score(self, s: f32) -> Self

Drop entries whose recomputed normalised keyword overlap with the query is below s ∈ [0, 1]. Default 0.0 (= keep all top_k).

Score formula: (distinct query tokens present in entry.content+tags) / (query token count)

So a query of 4 tokens needs ≥3 to land in the entry to score ≥ 0.75.

Source

pub fn with_required_tags( self, tags: impl IntoIterator<Item = impl Into<String>>, ) -> Self

Only inject entries that have ALL of these tags. Empty = no filter.

Source

pub fn with_excluded_tags( self, tags: impl IntoIterator<Item = impl Into<String>>, ) -> Self

Drop entries that have ANY of these tags. Empty = no filter.

Trait Implementations§

Source§

impl Guide for MemoryGuide

Source§

fn id(&self) -> &GuideId

Source§

fn kind(&self) -> Execution

Source§

fn scope(&self) -> &GuideScope

Source§

fn apply<'life0, 'life1, 'life2, 'async_trait>( &'life0 self, ctx: &'life1 mut Context, _w: &'life2 World, ) -> Pin<Box<dyn Future<Output = Result<(), GuideError>> + Send + 'async_trait>>
where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Called ONCE per session, at the start, before the first model call. Use for content that doesn’t change across iterations (profile, skills catalogue, static instructions).
Source§

fn apply_before_iter<'life0, 'life1, 'life2, 'async_trait>( &'life0 self, ctx: &'life1 mut Context, _w: &'life2 World, ) -> Pin<Box<dyn Future<Output = Result<(), GuideError>> + Send + 'async_trait>>
where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Called BEFORE every model.complete() call within a session (default: no-op). Override to inject content that should adapt to the current conversation state — most useful for recall-style guides that want to re-query an external store based on the last user message. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> PolicyExt for T
where T: ?Sized,

Source§

fn and<P, B, E>(self, other: P) -> And<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow only if self and other return Action::Follow. Read more
Source§

fn or<P, B, E>(self, other: P) -> Or<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow if either self or other returns Action::Follow. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more