Expand description
Background extraction queue with bounded concurrency. Bounded extraction queue with backpressure and graceful shutdown.
Instead of fire-and-forget tokio::spawn per extraction request,
this module provides a bounded channel + worker pool. Benefits:
- Backpressure: at most
QUEUE_CAPACITYpending extractions - Bounded concurrency:
MAX_CONCURRENTparallel LLM calls - Graceful drain: on shutdown, the worker finishes in-flight work
Structs§
- Extraction
Request - What we send into the queue.
Functions§
- spawn_
worker - Spawn the extraction worker. Returns the sender half and a join handle that resolves when all in-flight work is drained.