Struct RLUCacheMemory 

pub struct RLUCacheMemory { /* private fields */ }

A memory structure that stores messages in an LRU (Least Recently Used) cache.

Implementations

impl RLUCacheMemory

pub fn new(capacity: usize) -> Self

Creates a new RLUCacheMemory with the specified capacity.

pub fn capacity(&self) -> usize

Get the capacity.

Trait Implementations

impl From<RLUCacheMemory> for Arc<Mutex<dyn Memory>>

Converts RLUCacheMemory into an Arc<Mutex<dyn Memory>>.

fn from(val: RLUCacheMemory) -> Self

Converts to this type from the input type.

impl From<RLUCacheMemory> for Arc<dyn Memory>

Converts RLUCacheMemory into an Arc<dyn Memory>.

fn from(val: RLUCacheMemory) -> Self

Converts to this type from the input type.

impl Memory for RLUCacheMemory

fn messages(&self) -> Vec<Message>

Returns all messages in the cache.

fn add_message(&mut self, message: Message)

Adds a message to the cache, evicting the least recently used message if the cache is full.

fn clear(&mut self)

Clears all messages from the cache.

fn add_user_message(&mut self, message: &dyn Display)

Adds a user (human) message to the memory.

fn add_ai_message(&mut self, message: &dyn Display)

Adds an AI (LLM) message to the memory.

fn to_string(&self) -> String

Converts the memory’s messages to a string representation.