Struct TimeoutMiddleware 

pub struct TimeoutMiddleware { /* private fields */ }

Enforces a per-call time limit on LLM completion requests.

Returns PeError::Timeout if the inner call exceeds the configured duration.

Implementations

impl TimeoutMiddleware

pub fn new(duration: Duration) -> Self

Create a timeout middleware with the given deadline per call.

Trait Implementations

impl ProviderMiddleware for TimeoutMiddleware

fn wrap_complete<'life0, 'life1, 'life2, 'life3, 'async_trait>( &'life0 self, messages: &'life1 [Message], tools: &'life2 [ToolSchema], next: &'life3 dyn LlmProvider, ) -> Pin<Box<dyn Future<Output = Result<LlmResponse, PeError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait, 'life3: 'async_trait,

Wrap a completion call. Call next.complete(messages, tools).await to forward to the next layer (or the base provider).