Struct ToolCallDetector 

pub struct ToolCallDetector { /* private fields */ }

Incremental tool-call detector.

Feed token text via feed as tokens are generated. When a complete tool call (open delimiter + valid JSON + close delimiter) is recognised, feed returns Some(ToolCall).

The detector maintains a rolling scan buffer to handle delimiters that span multiple tokens.

Example

use oxillama_runtime::tool_dispatch::{ToolCallDetector, ToolCallGrammar};

let mut detector = ToolCallDetector::new(ToolCallGrammar::Llama3);
let call = detector.feed("<|tool_call|>{\"name\":\"ping\",\"args\":{}}<|/tool_call|>");
assert!(call.is_some());

Implementations

impl ToolCallDetector

pub fn new(grammar: ToolCallGrammar) -> Self

Construct a new detector for the given grammar.

pub fn feed(&mut self, token_text: &str) -> Option<ToolCall>

Feed one token’s decoded text into the detector.

Returns Some(ToolCall) when a complete, valid tool call is detected. Returns None while the tool call is still accumulating or if the text is not a tool call.

After returning Some, the detector automatically resets to Idle. This means it can detect multiple sequential tool calls: feed text from the second call and it will be detected in a subsequent call.

pub fn reset(&mut self)

Reset the detector to the idle state, discarding any buffered content.