Enum EvictionStrategy 

pub enum EvictionStrategy {
    PerItem,
    Bulk {
        overflow: usize,
    },
    Compact {
        compact_count: usize,
    },
}

Eviction strategy for SlidingWindow regions.

Controls how entries are removed when the window exceeds its max_items limit. The choice of strategy affects prompt caching effectiveness: PerItem eviction shifts the message prefix every iteration (breaking cache), while Bulk and Compact keep the prefix stable between eviction events.

Variants

PerItem

Evict one turn group at a time (current behavior). Default.

Bulk

Evict in bulk when items exceed max + overflow. Between bulk evictions, the prefix stays stable for caching.

Fields

overflow: usize

How many items over max_items before triggering a bulk eviction. When triggered, evicts items back down to max_items.

Compact

Summarize oldest entries when threshold is hit (requires external LLM call). The region stores a pending_compaction flag; the runtime checks this and performs compaction externally.

Fields

compact_count: usize

Number of oldest entries to compact into a summary when triggered.

Trait Implementations

impl Clone for EvictionStrategy

fn clone(&self) -> EvictionStrategy

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for EvictionStrategy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for EvictionStrategy

fn default() -> EvictionStrategy

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for EvictionStrategy

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Eq for EvictionStrategy

impl PartialEq for EvictionStrategy

fn eq(&self, other: &EvictionStrategy) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for EvictionStrategy

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for EvictionStrategy