Skip to main content

Module context_manager

Module context_manager 

Source
Expand description

Structsยง

CompactionReport
Reports what ContextManager::compact_if_needed did when it ran. Returned wrapped in Option: None means compaction was not needed (history fits within max_tokens).
ContextManager
Owns the message vector backing a single conversation, plus the budget and pin mask that govern how compaction reduces it.
ContextManagerBuilder
Configuration for a ContextManager.