Struct CompressionMiddleware 

pub struct CompressionMiddleware { /* private fields */ }

Middleware that compresses conversation history before each LLM call.

Wraps a ContextCompactor and forwards on_pre_llm to its compact method. When the estimated token count is below CompressionConfig::trigger_tokens, the middleware is a no-op and the original messages pass through unchanged.

A CompressionPolicy controls whether compression actually proceeds once the threshold is crossed. Use with_policy to supply a custom policy (e.g. user confirmation, rate limiting).

Usage

use agent_works::compression::{CompressionConfig, CompressionMiddleware};

let mw = CompressionMiddleware::new(config, client);
builder.middleware(mw);

Implementations

impl CompressionMiddleware

pub fn new(config: CompressionConfig, client: Arc<dyn LlmProvider>) -> Self

Create a new middleware with the given config and LLM client.

Uses AutoCompressionPolicy (always compress when threshold is hit).

pub fn from_compactor(compactor: ContextCompactor) -> Self

Create a new middleware from an existing ContextCompactor.

Uses AutoCompressionPolicy.

pub fn with_policy( config: CompressionConfig, client: Arc<dyn LlmProvider>, policy: Box<dyn CompressionPolicy>, ) -> Self

Create a new middleware with a custom CompressionPolicy.

pub fn compactor(&self) -> &ContextCompactor

Access the inner compactor (e.g. for /compact or cache clearing).

pub fn clone_compactor(&self) -> ContextCompactor

Create a cloned handle of the inner compactor.

The clone shares the same cache — clearing it through either handle affects both. Useful for storing a separate handle outside the middleware (e.g. in PhiAgent for /compact access).

pub fn config(&self) -> &CompressionConfig

Access the compression config.

Trait Implementations

impl Middleware for CompressionMiddleware

fn on_pre_llm<'life0, 'life1, 'async_trait>( &'life0 self, ctx: &'life1 mut PreLlmCtx, ) -> Pin<Box<dyn Future<Output = AgentResult<()>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

fn on_user_message<'life0, 'life1, 'async_trait>( &'life0 self, _ctx: &'life1 mut UserMessageCtx, ) -> Pin<Box<dyn Future<Output = Result<(), AgentError>> + Send + 'async_trait>>

where 'life0: 'async_trait, 'life1: 'async_trait, Self: 'async_trait,

fn on_post_llm<'life0, 'life1, 'async_trait>( &'life0 self, _ctx: &'life1 mut PostLlmCtx, ) -> Pin<Box<dyn Future<Output = Result<(), AgentError>> + Send + 'async_trait>>

where 'life0: 'async_trait, 'life1: 'async_trait, Self: 'async_trait,