Struct LlmSummarizer 

pub struct LlmSummarizer { /* private fields */ }

LLM-based summarizer that calls the current session’s model to generate a rich summary of compressed/removed messages.

Falls back to HeuristicSummarizer if the LLM call fails.

Implementations

impl LlmSummarizer

pub fn new( llm: Arc<dyn LLMProvider>, model: String, existing_summary: Option<String>, task_list_prompt: Option<String>, ) -> Self

pub fn with_context_blocks(self, context_blocks: Vec<ContextBlock>) -> Self

pub fn with_custom_instructions(self, instructions: Option<String>) -> Self

pub fn with_summary_mode(self, mode: SummaryMode) -> Self

Trait Implementations

impl Debug for LlmSummarizer

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Summarizer for LlmSummarizer

fn summarize<'life0, 'life1, 'async_trait>( &'life0 self, messages: &'life1 [Message], ) -> Pin<Box<dyn Future<Output = Result<String, BudgetError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Generate a summary of the given messages.

fn estimate_summary_tokens(&self, message_count: usize) -> u32

Get the estimated token count of the summary.