Struct TokenAwareMemory 

pub struct TokenAwareMemory { /* private fields */ }

Memory backend that trims history to fit a token budget.

Implementations

impl TokenAwareMemory

pub fn new(max_tokens: usize) -> Self

Creates a token-aware backend with the default tokenizer.

pub fn with_tokenizer(max_tokens: usize, tokenizer: Arc<dyn Tokenizer>) -> Self

Creates a token-aware backend with a custom tokenizer.

Trait Implementations

impl Memory for TokenAwareMemory

fn store<'life0, 'life1, 'async_trait>( &'life0 mut self, _key: &'life1 str, value: Message, ) -> Pin<Box<dyn Future<Output = Result<()>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Stores a message under a logical key.

fn retrieve<'life0, 'life1, 'async_trait>( &'life0 self, query: &'life1 str, limit: usize, ) -> Pin<Box<dyn Future<Output = Result<Vec<Message>>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Retrieves relevant messages for a query.

fn history<'life0, 'async_trait>( &'life0 self, ) -> Pin<Box<dyn Future<Output = Result<Vec<Message>>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Returns the full conversation history.

fn clear<'life0, 'async_trait>( &'life0 mut self, ) -> Pin<Box<dyn Future<Output = Result<()>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Clears the memory backend.

impl SearchableMemory for TokenAwareMemory

fn token_count<'life0, 'async_trait>( &'life0 self, ) -> Pin<Box<dyn Future<Output = Result<usize>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Returns the approximate token count for the current history.

fn search<'life0, 'life1, 'async_trait>( &'life0 self, query: &'life1 str, limit: usize, ) -> Pin<Box<dyn Future<Output = Result<Vec<Message>>> + Send + 'async_trait>>

where Self: Sync + 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Semantic or lexical search over memory.