ToolTimeoutManager

Struct ToolTimeoutManager 

Source
pub struct ToolTimeoutManager { /* private fields */ }
Expand description

Tool timeout and cancellation manager

Manages per-tool timeout policies and provides cancellation-safe timeout enforcement for tool execution with comprehensive audit logging.

Implementations§

Source§

impl ToolTimeoutManager

Source

pub fn new(config: TimeoutConfig, metrics: Arc<ServerMetrics>) -> Self

Create a new timeout manager with the given configuration and metrics

Source

pub fn get_tool_timeout(&self, tool_name: &str) -> Duration

Get the timeout duration for a specific tool

Returns per-tool override if configured, otherwise returns default timeout.

Source

pub async fn execute_with_timeout_and_cancellation<F, T>( &self, tool_name: &str, operation: F, ) -> Result<(T, CancellationToken), ToolTimeoutError>
where F: Future<Output = Result<T, ServerError>>, T: Send,

Execute a tool with timeout and cooperative cancellation support

This is the primary method for executing tools with comprehensive timeout and cancellation handling following Tokio best practices.

Returns both the result and the cancellation token for context propagation.

Source

pub async fn execute_with_external_token<F, T>( &self, tool_name: &str, operation: F, cancellation_token: CancellationToken, ) -> Result<T, ToolTimeoutError>
where F: Future<Output = Result<T, ServerError>>, T: Send,

Execute a tool with a provided cancellation token

This method allows external code to provide the cancellation token, enabling tight integration with RequestContext and other systems.

Source

pub async fn execute_with_timeout<F, T>( &self, tool_name: &str, operation: F, ) -> Result<T, ToolTimeoutError>
where F: Future<Output = Result<T, ServerError>>, T: Send,

Execute a tool with timeout (backward compatible API)

This method provides backward compatibility for existing code that doesn’t need access to the cancellation token. New code should use execute_with_timeout_and_cancellation for cooperative cancellation support.

Source

pub async fn get_active_executions(&self) -> Vec<ActiveExecutionInfo>

Get statistics about active tool executions

Returns information about currently running tools for monitoring and debugging purposes.

Source

pub async fn cancel_all_executions(&self)

Cancel all active executions (for graceful shutdown)

Signals cooperative cancellation to all active tool executions. Tools that check their cancellation tokens will receive the signal and can perform graceful cleanup before terminating.

Trait Implementations§

Source§

impl Clone for ToolTimeoutManager

Source§

fn clone(&self) -> ToolTimeoutManager

Returns a duplicate of the value. Read more
1.0.0 · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for ToolTimeoutManager

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> Pointable for T

Source§

const ALIGN: usize

The alignment of pointer.
Source§

type Init = T

The type for initializers.
Source§

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more
Source§

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more
Source§

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more
Source§

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V

Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more