Struct StreamingToolExecutor 

pub struct StreamingToolExecutor { /* private fields */ }

Executes tools eagerly as they arrive from a streaming LLM response.

Call submit each time a complete tool_use block is received from the stream. After the stream ends, call collect to await all pending tasks and retrieve results in submission order.

Implementations

impl StreamingToolExecutor

pub fn new() -> Self

Create a new executor with no pending tasks.

pub fn submit( &mut self, item: ToolCallItem, tool_map: &HashMap<String, Arc<dyn Tool>>, timeout: Option<Duration>, ctx: &ToolContext, )

Submit a tool for immediate execution.

The tool is looked up in tool_map and spawned as a background task. If the tool is not found, the task will resolve with an error result.

pub fn has_pending(&self) -> bool

Returns true if any tools have been submitted.

pub async fn collect(self) -> (Vec<ToolCallItem>, Vec<ToolResult>)

Await all submitted tasks and return (items, results) in submission order.

Items and results are returned as separate vectors so callers can use the existing execute_and_record_tool_calls pipeline unchanged.

Trait Implementations

impl Default for StreamingToolExecutor

fn default() -> Self

Returns the “default value” for a type.