Skip to main content

Module buffer

Module buffer 

Source
Expand description

Response buffer for HITL (Human-in-the-Loop) agent control.

Sits between LLM completion and NATS publish, allowing operators to inspect, hold, release, or reject agent responses before they reach the orchestrator.

Structs§

BufferEntryDetail
Full detail of a buffered entry, including the deserialized payload content.
BufferEntrySummary
Lightweight summary of a buffered entry for the dashboard UI.
BufferedResponse
A completed agent response held in the buffer before NATS publication.
NatsAckHandle
AckHandle backed by a real NATS JetStream message.
PreAckedHandle
No-op AckHandle for entries whose NATS message was already acked at buffer-push time.
ResponseBuffer
Thread-safe response buffer with pause/resume and manual release/reject.

Traits§

AckHandle
Callback to ack the original NATS JetStream message.

Functions§

compute_adaptive_hold
Compute an adaptive hold duration based on an agent’s mean score.
compute_divergence