Skip to main content

Crate faucet_source_kinesis

Crate faucet_source_kinesis 

Source
Expand description

§faucet-source-kinesis

AWS Kinesis Data Streams source connector for faucet-stream: consumes records from every (or selected) shard with bounded per-shard concurrency, resumable per-shard sequence-number checkpoints, throttle-aware backoff, and the standard idle_termination_secs / max_messages termination knobs (mirroring the Kafka source).

Delivery is at-least-once: a restart between a sink write and the bookmark persist re-delivers records at the boundary. Pair with an upsert sink keyed on sequence_number when replays must converge.

Structs§

KinesisSource
AWS Kinesis Data Streams source. See the crate README for semantics.
KinesisSourceConfig
Configuration for KinesisSource.
ShardBookmarks
The persisted bookmark value.

Enums§

KinesisCredentials
How to authenticate with AWS Kinesis.
OnDecodeError
KinesisSourceConfig::on_decode_error.
StartPosition
Where a shard starts reading when no persisted bookmark exists for it.
ValueFormat
How each record’s Data blob is decoded into the emitted data field.

Constants§

DESCRIPTOR
The connector’s static descriptor (RFC 0013): its capabilities, answered from config alone.

Functions§

build_client
Build an aws_sdk_kinesis::Client from region / endpoint / credentials.