Crate faucet_source_kafka 

faucet-source-kafka

Apache Kafka consumer source for faucet-stream. Subscribes to one or more topics, drains messages until max_messages or idle_timeout, and yields each message as a JSON object with key/value/topic/partition/ offset/timestamp/headers fields.

Re-exports

pub use config::KafkaSourceConfig;

pub use config::OffsetReset;

pub use stream::KafkaSource;

Modules

config

Configuration types for the Kafka source.

decode

Decode Kafka message bytes into JSON Values, dispatching on KafkaValueFormat.

shard

Group-member sharding for clustered (Mode B) execution — issue #261.

state

Bookmark <-> JSON serialization for Kafka offset progress.

stream

KafkaSource — the Kafka consumer implementation.

Structs

BasicAuth

Basic username/password credentials reused across auth modes.

SchemaRegistryConfigschema-registry

Confluent Schema Registry connection settings.

Enums

CompressionType

Producer-side compression for outbound batches.

FaucetError

All possible errors returned by faucet-stream.

KafkaAuth

Kafka broker authentication configuration.

KafkaValueFormat

How a Kafka message value (or key) is encoded on the wire.

OnDecodeError

What the source does when a single message fails to decode.

OnKeyError

What the sink does when key/partition extraction fails for a record.

ScramMechanism

SCRAM hash algorithm used for SASL/SCRAM authentication.

Traits

Source

A source fetches records from an external system.