Struct LocalSummarizer 

pub struct LocalSummarizer { /* private fields */ }

Summarizer for context compression

Implementations

impl LocalSummarizer

pub fn new(provider: Arc<dyn Provider>, model_id: impl Into<String>) -> Self

Create a new summarizer

pub fn with_max_summary_tokens(self, tokens: u32) -> Self

Set maximum summary tokens

pub fn with_max_facts(self, facts: usize) -> Self

Set maximum facts to extract

pub async fn summarize_message( &self, content: &str, role: &str, ) -> Option<SummarizationResult>

Summarize a message for warm tier storage

Generates a 50-100 word summary suitable for the warm memory tier.

pub async fn extract_facts(&self, summary: &str) -> Option<Vec<ExtractedFact>>

Extract key facts from a summary for cold tier storage

Parses structured facts from content for ultra-compressed archival.

pub async fn compact_conversation( &self, messages: &[(String, String)], keep_recent: usize, ) -> Option<String>

Compact a conversation for emergency context reduction

Used when token count exceeds threshold (e.g., 80k tokens).

pub fn summarize_heuristic(&self, content: &str) -> SummarizationResult

Heuristic summarization (no LLM)

pub fn extract_entities(&self, content: &str) -> Vec<String>

Extract entities from content for summary metadata