Expand description
§faucet-source-kinesis
AWS Kinesis Data Streams source connector for
faucet-stream: consumes
records from every (or selected) shard with bounded per-shard concurrency,
resumable per-shard sequence-number checkpoints, throttle-aware backoff,
and the standard idle_termination_secs / max_messages termination
knobs (mirroring the Kafka source).
Delivery is at-least-once: a restart between a sink write and the
bookmark persist re-delivers records at the boundary. Pair with an upsert
sink keyed on sequence_number when replays must converge.
Structs§
- Kinesis
Source - AWS Kinesis Data Streams source. See the crate README for semantics.
- Kinesis
Source Config - Configuration for
KinesisSource. - Shard
Bookmarks - The persisted bookmark value.
Enums§
- Kinesis
Credentials - How to authenticate with AWS Kinesis.
- OnDecode
Error KinesisSourceConfig::on_decode_error.- Start
Position - Where a shard starts reading when no persisted bookmark exists for it.
- Value
Format - How each record’s
Datablob is decoded into the emitteddatafield.
Constants§
- DESCRIPTOR
- The connector’s static descriptor (RFC 0013): its capabilities, answered from config alone.
Functions§
- build_
client - Build an
aws_sdk_kinesis::Clientfrom region / endpoint / credentials.