Expand description
Response buffer for HITL (Human-in-the-Loop) agent control.
Sits between LLM completion and NATS publish, allowing operators to inspect, hold, release, or reject agent responses before they reach the orchestrator.
Structs§
- Buffer
Entry Detail - Full detail of a buffered entry, including the deserialized payload content.
- Buffer
Entry Summary - Lightweight summary of a buffered entry for the dashboard UI.
- Buffered
Response - A completed agent response held in the buffer before NATS publication.
- Nats
AckHandle AckHandlebacked by a real NATS JetStream message.- PreAcked
Handle - No-op
AckHandlefor entries whose NATS message was already acked at buffer-push time. - Response
Buffer - Thread-safe response buffer with pause/resume and manual release/reject.
Traits§
- AckHandle
- Callback to ack the original NATS JetStream message.
Functions§
- compute_
adaptive_ hold - Compute an adaptive hold duration based on an agent’s mean score.
- compute_
divergence