Struct SummarizationTrimmer 

pub struct SummarizationTrimmer { /* private fields */ }

Summarization-based trimmer.

When context approaches the limit, uses a callback to summarize older messages into a compact form.

Example

use bob_core::context_trimmer::{ContextTrimmer, SummarizationTrimmer};

let trimmer = SummarizationTrimmer::new(
    100,
    4096,
    Arc::new(my_summarizer), // impl MessageSummarizer
);

Implementations

impl SummarizationTrimmer

pub fn new( max_messages: usize, target_tokens: usize, summarizer: Arc<dyn MessageSummarizer>, ) -> Self

Create a new summarization trimmer.

pub fn with_config( config: TrimConfig, summarizer: Arc<dyn MessageSummarizer>, ) -> Self

Create with full configuration.

Trait Implementations

impl ContextTrimmer for SummarizationTrimmer

fn trim<'life0, 'life1, 'life2, 'async_trait>( &'life0 self, messages: &'life1 [Message], _usage: &'life2 TokenUsage, ) -> Pin<Box<dyn Future<Output = Result<TrimResult, AgentError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Trim the message history according to the strategy.

fn strategy_name(&self) -> &'static str

Human-readable name of this trimming strategy.

impl Debug for SummarizationTrimmer

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.