Struct Compactor 

pub struct Compactor {
    pub threshold: usize,
    pub keep_recent: usize,
    pub keep_start: usize,
    /* private fields */
}

Compacts conversation history using LLM summarization.

Fields

threshold: usize

Token threshold — compact when estimated tokens exceed this.

keep_recent: usize

Number of recent messages to keep uncompacted.

keep_start: usize

Number of initial messages to preserve (system + first user).

Implementations

impl Compactor

pub fn new(threshold: usize) -> Self

Create a compactor with the given token threshold.

pub fn with_keep(self, start: usize, recent: usize) -> Self

Create with custom keep parameters.

pub fn with_prompt(self, prompt: impl Into<String>) -> Self

Use a custom compaction prompt instead of the default.

Useful for domain-specific compaction (e.g., sales coaching, code review).

pub fn needs_compaction(&self, messages: &[Message]) -> bool

Check if compaction is needed based on estimated token count.

pub async fn compact( &self, summarizer: &dyn LlmClient, messages: &mut Vec<Message>, ) -> Result<bool, CompactionError>

Compact messages using an LLM summarizer.

Replaces messages[keep_start..len-keep_recent] with a single summary message. Returns true if compaction was performed.

Trait Implementations

impl Default for Compactor

fn default() -> Self

Returns the “default value” for a type.