Module queue 

Pluggable message queue for decoupling document discovery from ingestion.

The default is an in-process memory channel; RabbitMQ and Redis pub/sub are available behind the rabbitmq and redis features. Payloads are opaque byte blobs (the pipeline publishes JSON-encoded crate::source::SourceRefs).

Modules

memory

In-process message queue built on a tokio broadcast channel.

Constants

TOPIC

The queue/topic name used across backends.

Traits

MessageQueue

A pluggable publish/subscribe message queue.

QueueReceiver

A subscription that yields published payloads until the queue closes.

Functions

from_config

Build the queue selected by cfg.queue.