Expand description
§faucet-sink-kinesis
AWS Kinesis Data Streams sink connector for
faucet-stream: batched
PutRecords writes with configurable partition-key derivation, bounded
concurrent in-flight requests, per-entry partial-failure retry, and
DLQ-routable per-record outcomes.
Delivery is at-least-once: an ambiguous whole-request failure that is retried can double-write records that actually landed. Key downstream consumers on an idempotency field when replays must converge.
Structs§
- Kinesis
Sink - AWS Kinesis Data Streams sink. See the crate README for semantics.
- Kinesis
Sink Config - Configuration for
KinesisSink.
Enums§
- Explicit
Hash Key - Optional explicit hash key override (routes by hash instead of the partition key’s MD5).
- Kinesis
Credentials - How to authenticate with AWS Kinesis.
- Partition
Key - How each record’s Kinesis partition key is derived.
- Value
Format - How each record is encoded into the Kinesis
Datablob.
Constants§
- DESCRIPTOR
- The connector’s static descriptor (RFC 0013): its capabilities, answered from config alone.
- MAX_
ENTRIES_ PER_ REQUEST - Kinesis hard limit:
PutRecordsaccepts at most 500 entries per request. - MAX_
RECORD_ BYTES - Kinesis hard limit: 1 MiB per record (data + partition key).
- MAX_
REQUEST_ BYTES - Kinesis hard limit: 5 MiB per
PutRecordsrequest.
Functions§
- build_
client - Build an
aws_sdk_kinesis::Clientfrom region / endpoint / credentials.