Skip to main content

Module streaming

Module streaming 

Source
Expand description

Streaming Tool Calls

Provides a streaming agent that emits LLM text token by token and exposes tool-call state.

B8 (v0.22.4): sse maps AgentStreamEvent to Server-Sent Events frames; the sse-server feature serves them at text/event-stream over axum 0.7 (POST|GET /agent/stream).

Re-exports§

pub use state::AgentStreamEvent;
pub use state::ToolCallState;
pub use tool_call_stream::StreamingFunctionCallingAgent;
pub use sse::agent_sse_frames;
pub use sse::encode_sse_frame;
pub use sse::sse_event_name;
pub use sse::sse_event_payload;
pub use sse::AgentEventStream;
pub use sse::AgentSseRequest;
pub use sse::SseFrame;
pub use sse::SseOptions;

Modules§

sse
Agent events → Server-Sent Events framing (B8, v0.22.4).
state
Streaming tool-call states and events
tool_call_stream
StreamingFunctionCallingAgent - streaming output agent