faucet-source-sqs 1.0.0

AWS SQS source connector for faucet-stream (long-poll receive, at-least-once drain, delete-on-emit)
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25

#![cfg_attr(docsrs, feature(doc_cfg))]

//! # faucet-source-sqs
//!
//! AWS SQS source connector for
//! [faucet-stream](https://github.com/PawanSikawat/faucet-stream): long-polls
//! `ReceiveMessage`, buffers up to `batch_size` messages, and emits them as
//! pages with bounded memory. Each page's receipt handles are deleted right
//! before the page is yielded, and a run terminates on `idle_timeout_secs`
//! and/or `max_messages`.
//!
//! Delivery is **at-least-once**: a crash after a page is emitted but before
//! the downstream sink durably commits it re-reads any message whose delete did
//! not land (or whose visibility window elapsed). Pair with an idempotent /
//! upsert sink when replays must converge. The queue is drained top-to-bottom
//! with no resumable bookmark — every page carries `bookmark: None`.

mod config;
mod stream;

pub use config::{MAX_RECEIVE_BATCH, MAX_WAIT_TIME_SECONDS, SqsSourceConfig};
pub use stream::SqsSource;

// Shared connection types, re-exported so users need only this crate.
pub use faucet_common_sqs::{SqsCredentials, build_client};