Struct ToolCallBuffer 

pub struct ToolCallBuffer { /* private fields */ }

Available on crate feature models only.

Streaming buffer that accumulates tokens and detects tool call boundaries.

Use this in streaming response handlers to buffer tokens when a tool call prefix is detected, then parse and emit Part::FunctionCall when the closing tag arrives.

Example

let mut buffer = ToolCallBuffer::new();

for chunk in stream {
    match buffer.push(&chunk.text) {
        BufferAction::Emit(parts) => {
            for part in parts { yield part; }
        }
        BufferAction::Buffering => { /* still accumulating */ }
    }
}
// Flush any remaining content at end of stream
for part in buffer.flush() { yield part; }

Implementations

impl ToolCallBuffer

pub fn new() -> ToolCallBuffer

Create a new empty buffer.

pub fn push(&mut self, text: &str) -> BufferAction

Push a text chunk into the buffer.

Returns BufferAction::Emit with parts to yield, or BufferAction::Buffering if we’re accumulating a potential tool call.

pub fn flush(&mut self) -> Vec<Part>

Flush any remaining buffered content as parts. Call this when the stream ends.

Trait Implementations

impl Default for ToolCallBuffer

fn default() -> ToolCallBuffer

Returns the “default value” for a type.