Skip to main content

Module inference

Module inference 

Source
Expand description

InferenceTool — sub-model invocation for agent delegation.

Allows an agent to run a secondary LLM completion via the same driver, useful for chain-of-thought delegation or specialized reasoning sub-tasks.

Structs§

InferenceTool
Tool that runs a sub-inference via the agent’s LLM driver.