Skip to main content

RepeatToolLimitMiddleware

Struct RepeatToolLimitMiddleware 

Source
pub struct RepeatToolLimitMiddleware { /* private fields */ }
Expand description

Break poll loops — repeated identical tool calls — hard.

Session 20260914_50cf809d: a root spawned two sub-agents, then polled list_agents 124 times over 15 minutes (57% of wall clock, interleaved with real work) instead of ending its turn to receive the pushed reports. The system prompt forbade polling; the model did it anyway, and no mechanism stopped it. This middleware is that mechanism.

Counting is cumulative per run, not consecutive: the incident’s polls were interleaved with read_file etc., so a consecutive-counter would reset forever and never fire. The fingerprint is tool name + canonical (key-sorted) arguments — a model legitimately reading 51 different files never accumulates a fingerprint.

Two-stage response, mirroring existing middleware precedents:

  • at nudge_after (once per fingerprint): follow_up_message nudge (soft, like MaxTurnsNudgeMiddleware);
  • at block_after (and every attempt beyond): pending tool_calls are discarded and a follow-up forces a summary (hard, like TurnToolLimitMiddleware).

State is per-session and reset by on_user_message — a run’s counts must not leak into the next run (the middleware instance is process-long in phimint). Clearing all pending calls on block (not just the offending one) follows the TurnToolLimitMiddleware precedent: the breaker only trips after block_after identical calls, so collateral is negligible.

Implementations§

Trait Implementations§

Source§

impl Middleware for RepeatToolLimitMiddleware

Source§

fn on_user_message<'life0, 'life1, 'async_trait>( &'life0 self, ctx: &'life1 mut UserMessageCtx, ) -> Pin<Box<dyn Future<Output = AgentResult<()>> + Send + 'async_trait>>
where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Source§

fn on_post_llm<'life0, 'life1, 'async_trait>( &'life0 self, ctx: &'life1 mut PostLlmCtx, ) -> Pin<Box<dyn Future<Output = AgentResult<()>> + Send + 'async_trait>>
where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Source§

fn on_pre_llm<'life0, 'life1, 'async_trait>( &'life0 self, _ctx: &'life1 mut PreLlmCtx, ) -> Pin<Box<dyn Future<Output = AgentResult<()>> + Send + 'async_trait>>
where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self> ⓘ

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self> ⓘ

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> PolicyExt for T
where T: ?Sized,

Source§

fn and<P, B, E>(self, other: P) -> And<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow only if self and other return Action::Follow. Read more
Source§

fn or<P, B, E>(self, other: P) -> Or<T, P>
where T: Sized + Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns Action::Follow if either self or other returns Action::Follow. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = !

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, !>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> ⓘ
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self> ⓘ

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more