Skip to main content

Crate faucet_sink_kinesis

Crate faucet_sink_kinesis 

Source
Expand description

§faucet-sink-kinesis

AWS Kinesis Data Streams sink connector for faucet-stream: batched PutRecords writes with configurable partition-key derivation, bounded concurrent in-flight requests, per-entry partial-failure retry, and DLQ-routable per-record outcomes.

Delivery is at-least-once: an ambiguous whole-request failure that is retried can double-write records that actually landed. Key downstream consumers on an idempotency field when replays must converge.

Structs§

KinesisSink
AWS Kinesis Data Streams sink. See the crate README for semantics.
KinesisSinkConfig
Configuration for KinesisSink.

Enums§

ExplicitHashKey
Optional explicit hash key override (routes by hash instead of the partition key’s MD5).
KinesisCredentials
How to authenticate with AWS Kinesis.
PartitionKey
How each record’s Kinesis partition key is derived.
ValueFormat
How each record is encoded into the Kinesis Data blob.

Constants§

DESCRIPTOR
The connector’s static descriptor (RFC 0013): its capabilities, answered from config alone.
MAX_ENTRIES_PER_REQUEST
Kinesis hard limit: PutRecords accepts at most 500 entries per request.
MAX_RECORD_BYTES
Kinesis hard limit: 1 MiB per record (data + partition key).
MAX_REQUEST_BYTES
Kinesis hard limit: 5 MiB per PutRecords request.

Functions§

build_client
Build an aws_sdk_kinesis::Client from region / endpoint / credentials.