Skip to main content

SummarizeCompactionStrategy

Struct SummarizeCompactionStrategy 

Source
pub struct SummarizeCompactionStrategy {
    pub trigger_fraction: f64,
    pub tail_min_messages: usize,
    pub summary_max_tokens: i32,
    pub summary_prompt: String,
    pub user_message_token_budget: u64,
}
Expand description

Codex-style local compaction: send the full history to the model with a handoff-summary prompt appended, collect the reply as a checkpoint, then rebuild history as [...retained user messages, summary].

Design rationale:

  • User messages are preserved verbatim (up to user_message_token_budget) because they carry precise constraints and goals that paraphrasing loses.
  • Assistant / tool messages are folded into the summary — they are large but low-density and tolerate lossy compression.
  • The summary is placed LAST so the model reads it as the most recent context rather than as background preamble.
  • Reusing the same model client keeps the Anthropic prompt-cache prefix hot (identical system + tools on every call).

Fields§

§trigger_fraction: f64§tail_min_messages: usize

Minimum total message count below which compaction is skipped. Does not control retention; use user_message_token_budget for that.

§summary_max_tokens: i32§summary_prompt: String§user_message_token_budget: u64

Token budget for verbatim user-message retention in the replacement history.

Implementations§

Source§

impl SummarizeCompactionStrategy

Source

pub fn with_trigger_fraction(self, fraction: f64) -> Self

Source

pub fn with_tail_min_messages(self, n: usize) -> Self

Source

pub fn with_summary_max_tokens(self, n: i32) -> Self

Source

pub fn with_user_message_token_budget(self, budget: u64) -> Self

Trait Implementations§

Source§

impl CompactionStrategy for SummarizeCompactionStrategy

Source§

fn should_compact( &self, messages: &[ChatMessage], context_window_tokens: u64, ) -> bool

Boolean gate. Pure (no side effects). Cheap to call every step.
Source§

fn compact<'life0, 'life1, 'async_trait>( &'life0 self, messages: Vec<ChatMessage>, ctx: &'life1 CompactionContext, ) -> Pin<Box<dyn Future<Output = Result<CompactionOutcome, CompactionError>> + Send + 'async_trait>>
where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Fold history. Caller hands over the full messages list and expects a shorter list back (typically [summary, ...tail]). Failures bubble up; agent_loop treats them as “skip this turn’s compaction” rather than failing the whole turn.
Source§

impl Default for SummarizeCompactionStrategy

Source§

fn default() -> Self

Returns the “default value” for a type. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> PolicyExt for T
where T: ?Sized,

Source§

fn and<P, B, E>(self, other: P) -> And<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow only if self and other return Action::Follow. Read more
Source§

fn or<P, B, E>(self, other: P) -> Or<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow if either self or other returns Action::Follow. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more