Struct Timeout 

pub struct Timeout {
    pub total: Option<Duration>,
    pub step: Option<Duration>,
    pub first_chunk: Option<Duration>,
    pub chunk: Option<Duration>,
    pub tool: Option<Duration>,
    pub per_tool: HashMap<ToolName, Duration>,
}

Timeouts applied to a call.

first_chunk and chunk only apply to streaming calls; total covers the whole call including tool execution.

Fields

total: Option<Duration>

Whole call.

step: Option<Duration>

One step (model call plus its tool executions).

first_chunk: Option<Duration>

Streaming: from the request until the first content part.

chunk: Option<Duration>

Streaming: between two consecutive content parts.

tool: Option<Duration>

Default per tool execution.

per_tool: HashMap<ToolName, Duration>

Per-tool overrides of tool.

Implementations

impl Timeout

pub fn none() -> Self

No timeouts.

pub fn with_total(self, total: Duration) -> Self

Sets the total timeout.

pub fn with_step(self, step: Duration) -> Self

Sets the step timeout.

pub fn with_first_chunk(self, first_chunk: Duration) -> Self

Sets the first-chunk timeout (streaming only).

pub fn with_chunk(self, chunk: Duration) -> Self

Sets the inter-chunk timeout (streaming only).

pub fn with_tool(self, tool: Duration) -> Self

Sets the default tool timeout.

pub fn with_tool_for(self, name: impl Into<ToolName>, timeout: Duration) -> Self

Sets the timeout of one tool.

pub fn tool_timeout(&self, tool: &ToolName) -> Option<Duration>

Returns the timeout for tool: the per-tool override, else the default tool timeout.

Trait Implementations

impl Clone for Timeout

fn clone(&self) -> Timeout

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Timeout

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for Timeout

fn default() -> Timeout

Returns the “default value” for a type.

impl Eq for Timeout

impl From<Duration> for Timeout

fn from(total: Duration) -> Self

A bare duration is the total timeout.

impl PartialEq for Timeout

fn eq(&self, other: &Timeout) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for Timeout