Expand description
§faucet-source-sqs
AWS SQS source connector for
faucet-stream: long-polls
ReceiveMessage, buffers up to batch_size messages, and emits them as
pages with bounded memory. Each page’s receipt handles are deleted right
before the page is yielded, and a run terminates on idle_timeout_secs
and/or max_messages.
Delivery is at-least-once: a crash after a page is emitted but before
the downstream sink durably commits it re-reads any message whose delete did
not land (or whose visibility window elapsed). Pair with an idempotent /
upsert sink when replays must converge. The queue is drained top-to-bottom
with no resumable bookmark — every page carries bookmark: None.
Structs§
- SqsSource
- AWS SQS source. See the crate README for semantics.
- SqsSource
Config - Configuration for
SqsSource.
Enums§
- SqsCredentials
- How to authenticate with AWS SQS.
Constants§
- MAX_
RECEIVE_ BATCH - SQS hard limit: at most 10 messages per
ReceiveMessagecall. - MAX_
WAIT_ TIME_ SECONDS - SQS long-poll ceiling:
ReceiveMessageaccepts at most a 20-second wait.
Functions§
- build_
client - Build an
aws_sdk_sqs::Clientfrom region / endpoint / credentials.