faucet-source-dynamodb 1.2.2

Amazon DynamoDB source (parallel scan, query, Streams CDC) for the faucet-stream ecosystem
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44

#![cfg_attr(docsrs, feature(doc_cfg))]

//! # faucet-source-dynamodb
//!
//! Amazon DynamoDB source connector for
//! [faucet-stream](https://github.com/faucet-hq/faucet-stream):
//!
//! - `mode: scan` — parallel `Scan` (`segments` → `Segment`/`TotalSegments`,
//!   also exposed as cluster shards), resumable per-segment cursors;
//! - `mode: query` — `Query` by key condition, optionally on an index;
//! - `mode: streams` — DynamoDB Streams CDC: parent-before-child shard
//!   ordering, cumulative per-shard sequence bookmarks, `cdc_unwrap`-compatible
//!   `{op, before, after, key}` envelopes, trim-horizon gap detection with
//!   `on_gap: fail | resnapshot`, and `capture_resume_position` for
//!   `faucet mirror`.
//!
//! Items are converted to plain JSON without precision loss (numbers that
//! are not exactly representable stay strings; sets become arrays; binary
//! becomes base64). Delivery is at-least-once.

mod config;
mod discover;
mod envelope;
mod lag;
mod lineage;
mod scan;
mod sched;
mod state;
mod stream;
mod streams;
#[cfg(test)]
mod test_support;

pub use config::{DynamoDbSourceConfig, MAX_SEGMENTS, OnGap, ReadMode, StreamStart};
pub use envelope::{build_envelope, op_for_event, snapshot_envelope};
pub use state::{ScanBookmark, SegmentCursor, StreamBookmark};
pub use stream::DynamoDbSource;

pub use faucet_common_dynamodb::{
    DynamoDbCredentials, RetryPolicy, ValueFormat, build_client, build_streams_client,
};

mod descriptor;
pub use descriptor::DESCRIPTOR;