Struct CompactionPolicy 

pub struct CompactionPolicy {
    pub window: Option<u64>,
    pub budget: Option<u64>,
    pub min_remaining: u64,
    pub keep_recent_tokens: u64,
    pub keep_recent_turns: usize,
}

When to compact and how much recent context to retain.

The model window is not stored here: it comes from crate::limits (the model’s advertised context) or an override, and is passed to CompactionPolicy::should_compact. budget is an optional working ceiling (cost control) that defaults to the window; min_remaining is the “minimum remaining context” trigger; the keep_recent_* fields are the absolute recent history retained after compacting.

Fields

window: Option<u64>

Context-window override, consulted only when crate::limits doesn’t know the model (see CompactionPolicy::context_window). None = derive it from the catalog, or fall back to a default.

budget: Option<u64>

Working ceiling in tokens. None = the model window. Capped to the window at trigger time, so it can never disable window safety.

min_remaining: u64

Compact once fewer than this many tokens remain below the ceiling (used >= ceiling - min_remaining).

keep_recent_tokens: u64

Recent context kept verbatim after compacting, in tokens.

keep_recent_turns: usize

Complete turns always kept, whatever their token size.

Implementations

impl CompactionPolicy

pub fn ceiling(&self, window: u64) -> u64

The working ceiling: the configured budget, capped to the model window.

pub fn context_window(&self, base_url: Option<&str>, model: &str) -> u64

The context window for model served from base_url: the model’s advertised context (via crate::limits) when known, else the configured CompactionPolicy::window, else crate::limits::DEFAULT_CONTEXT_WINDOW.

pub fn should_compact(&self, window: u64, used: u64) -> bool

True once the provider-reported used input tokens leave less than min_remaining free below the ceiling.

Trait Implementations

impl Clone for CompactionPolicy

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for CompactionPolicy

impl Debug for CompactionPolicy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for CompactionPolicy

fn default() -> Self

Returns the “default value” for a type.

impl Eq for CompactionPolicy

impl PartialEq for CompactionPolicy

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for CompactionPolicy