Expand description
§faucet-source-sqs
AWS SQS source connector for
faucet-stream: long-polls
ReceiveMessage, buffers up to batch_size messages, and emits them as
pages with bounded memory. Each page’s receipt handles are deleted once the
page has been written downstream (when the pipeline asks for the next
page), and a run terminates on idle_timeout_secs and/or max_messages.
Delivery is at-least-once: a crash after a page is emitted but before
the downstream sink durably commits it re-reads any message whose delete did
not land (or whose visibility window elapsed). Pair with an idempotent /
upsert sink when replays must converge. The queue is drained top-to-bottom
with no resumable bookmark — every page carries bookmark: None.
Structs§
- SqsSource
- AWS SQS source. See the crate README for semantics.
- SqsSource
Config - Configuration for
SqsSource.
Enums§
- SqsCredentials
- How to authenticate with AWS SQS.
Constants§
- DESCRIPTOR
- The connector’s static descriptor (RFC 0013): its capabilities, answered from config alone.
- MAX_
RECEIVE_ BATCH - SQS hard limit: at most 10 messages per
ReceiveMessagecall. - MAX_
WAIT_ TIME_ SECONDS - SQS long-poll ceiling:
ReceiveMessageaccepts at most a 20-second wait.
Functions§
- build_
client - Build an
aws_sdk_sqs::Clientfrom region / endpoint / credentials.