Struct OverflowHandler 

pub struct OverflowHandler { /* private fields */ }

Handler for context length exceeded errors.

Provides automatic compaction and retry functionality when the context length limit is exceeded.

Implementations

impl OverflowHandler

pub fn new(max_retries: u32) -> Self

Create a new OverflowHandler with the specified max retries.

Arguments

• max_retries - Maximum number of compaction retries allowed

pub fn is_context_overflow(error: &ProviderError) -> bool

Check if an error is a context overflow error.

Arguments

• error - The provider error to check

Returns

true if the error is a context length exceeded error.

pub fn compaction_attempted(&self) -> bool

Check if compaction has been attempted.

pub fn compaction_attempts(&self) -> u32

Get the number of compaction attempts made.

pub fn can_retry(&self) -> bool

Check if more retries are allowed.

pub fn reset(&mut self)

Reset the handler state for a new request cycle.

pub async fn handle_overflow( &mut self, provider: &dyn Provider, conversation: &Conversation, _session: &Session, ) -> Result<(Conversation, ProviderUsage, bool)>

Handle a context overflow error by compacting the conversation.

This method attempts to compact the conversation to reduce context size. If compaction succeeds, the caller should retry the request with the compacted conversation.

Arguments

• provider - The provider to use for summarization during compaction
• conversation - The current conversation to compact
• _session - The current session (for future use)

Returns

A tuple containing:

• Conversation: The compacted conversation
• ProviderUsage: Usage statistics from the compaction
• bool: Whether the caller should retry the request

Errors

Returns an error if:

• Maximum retries have been exceeded
• Compaction itself fails

pub async fn handle_overflow_with_pruning( &mut self, provider: &dyn Provider, conversation: &Conversation, session: &Session, pruning_config: &PruningConfig, ) -> Result<(Conversation, ProviderUsage, bool)>

Handle overflow with progressive pruning.

This method first attempts progressive pruning before falling back to full compaction.

Arguments

• provider - The provider to use for summarization
• conversation - The current conversation
• session - The current session
• pruning_config - Configuration for progressive pruning

Returns

Same as handle_overflow.

Trait Implementations

impl Default for OverflowHandler

fn default() -> Self

Returns the “default value” for a type.