lc-memory 0.22.4

Memory system for langchainrust — Buffer, Window, Summary, SummaryBuffer, ContextWindow, VectorStore, MongoDB persistence
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35

// lc-memory/src/context_window/mod.rs
//! Context Window for long context management.
//!
//! Manages conversation context by fitting messages within a token limit,
//! using either truncation or LLM-based summarization strategies.
//!
//! # Core Concepts
//!
//! - **ContextWindow**: Fits messages within a max token budget.
//! - **Strategy::Truncate**: Drops oldest messages, preserving system messages.
//! - **Strategy::Summarize**: Uses an LLM to compress old messages into a summary.
//!
//! # Example
//!
//! ```ignore
//! use lc_memory::{ContextWindow, Strategy};
//! use lc_core::token_counter::TiktokenCounter;
//!
//! // Truncation strategy
//! let cw = ContextWindow::new(4096)?;
//! let fitted = cw.fit(messages).await?;
//!
//! // Summarization strategy
//! let cw = ContextWindow::with_strategy(4096, Strategy::summarize(llm))?;
//! let fitted = cw.fit(messages).await?;
//! ```

pub mod manager;
pub mod trimmer;

pub use manager::ContextWindow;
pub use trimmer::Strategy;

#[cfg(test)]
mod tests;