Struct ContextWindow 

pub struct ContextWindow<M: BaseChatModel> { /* private fields */ }

Context window manager for fitting messages within a token budget.

Counts tokens using a TokenCounter (defaults to TiktokenCounter), and applies a Strategy when messages exceed max_tokens.

Implementations

impl<M: BaseChatModel> ContextWindow<M>

pub fn new(max_tokens: usize) -> Self

where TiktokenCounter: TokenCounter,

Creates a new ContextWindow with the Truncate strategy and default TiktokenCounter.

pub fn with_strategy(max_tokens: usize, strategy: Strategy<M>) -> Self

where TiktokenCounter: TokenCounter,

Creates a new ContextWindow with a specific strategy and default TiktokenCounter.

pub fn with_max_tokens(max_tokens: usize) -> Self

where TiktokenCounter: TokenCounter,

Creates a new ContextWindow with a custom max token limit and default counter/strategy.

pub fn with_counter(self, counter: Arc<dyn TokenCounter>) -> Self

Sets a custom token counter.

pub fn max_tokens(&self) -> usize

Returns the max token limit.

pub async fn fit( &self, messages: Vec<Message>, ) -> Result<Vec<Message>, MemoryError>

Fits messages within the token limit by applying the configured strategy.

• If total tokens are within max_tokens, returns messages as-is.
• If over, applies the Strategy (truncate or summarize).

Arguments

• messages - The conversation messages to fit.

Returns

A vector of messages that fits within the token budget.