Skip to main content

Crate faucet_source_sqs

Crate faucet_source_sqs 

Source
Expand description

§faucet-source-sqs

AWS SQS source connector for faucet-stream: long-polls ReceiveMessage, buffers up to batch_size messages, and emits them as pages with bounded memory. Each page’s receipt handles are deleted once the page has been written downstream (when the pipeline asks for the next page), and a run terminates on idle_timeout_secs and/or max_messages.

Delivery is at-least-once: a crash after a page is emitted but before the downstream sink durably commits it re-reads any message whose delete did not land (or whose visibility window elapsed). Pair with an idempotent / upsert sink when replays must converge. The queue is drained top-to-bottom with no resumable bookmark — every page carries bookmark: None.

Structs§

SqsSource
AWS SQS source. See the crate README for semantics.
SqsSourceConfig
Configuration for SqsSource.

Enums§

SqsCredentials
How to authenticate with AWS SQS.

Constants§

DESCRIPTOR
The connector’s static descriptor (RFC 0013): its capabilities, answered from config alone.
MAX_RECEIVE_BATCH
SQS hard limit: at most 10 messages per ReceiveMessage call.
MAX_WAIT_TIME_SECONDS
SQS long-poll ceiling: ReceiveMessage accepts at most a 20-second wait.

Functions§

build_client
Build an aws_sdk_sqs::Client from region / endpoint / credentials.