Struct LlmContextCompactor 

pub struct LlmContextCompactor<P: LlmProvider> { /* private fields */ }

LLM-based context compactor.

Uses the LLM itself to summarize older messages into a compact form.

Implementations

impl<P: LlmProvider> LlmContextCompactor<P>

pub const fn new(provider: Arc<P>, config: CompactionConfig) -> Self

Create a new LLM context compactor.

pub fn with_defaults(provider: Arc<P>) -> Self

Create with default configuration.

pub const fn config(&self) -> &CompactionConfig

Get the configuration.

Trait Implementations

impl<P: LlmProvider> ContextCompactor for LlmContextCompactor<P>

fn compact<'life0, 'life1, 'async_trait>( &'life0 self, messages: &'life1 [Message], ) -> Pin<Box<dyn Future<Output = Result<String>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Compact a list of messages into a summary.

fn estimate_tokens(&self, messages: &[Message]) -> usize

Estimate tokens for a message list.

fn needs_compaction(&self, messages: &[Message]) -> bool

Check if compaction is needed.

fn compact_history<'life0, 'async_trait>( &'life0 self, messages: Vec<Message>, ) -> Pin<Box<dyn Future<Output = Result<CompactionResult>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Perform full compaction, returning new message history.