Expand description
Tool executor: manages concurrent and serial tool execution.
The executor partitions tool calls into batches:
- Read-only (concurrency-safe) tools run in parallel
- Mutation tools run serially
This mirrors the streaming tool executor pattern where tools begin execution as soon as their input is fully parsed from the stream, maximizing throughput.
Structs§
- Pending
Tool Call - A pending tool call extracted from the model’s response.
- Tool
Call Result - Result of executing a tool call.
Functions§
- execute_
tool_ calls - Execute a batch of tool calls, respecting concurrency constraints.
- extract_
tool_ calls - Extract pending tool calls from assistant content blocks.