Module queue 

Tokio mpsc-based work queue for the batch processing pipeline.

The BatchQueue provides a bounded channel through which route handlers submit job IDs to the background BatchWorker. The worker receives job IDs, reads the input from disk, processes each line through the inference engine, and writes results back to disk.

Structs

BatchWorkItem

A single work item: a job ID to process.

Functions

new_batch_queue

Create a bounded batch work queue with the given capacity.

Type Aliases

BatchQueueReceiver

Receiver half of the batch work queue.

BatchQueueSender

Sender half of the batch work queue.