Expand description
Kafka source consumer implementation
This module provides a robust Kafka consumer implementation for ingesting events from Kafka topics with support for:
- Async message consumption with tokio
- Automatic reconnection on errors
- Configurable commit strategies (auto, manual, periodic)
- Multiple partition support
- Graceful shutdown
- Message deserialization with error handling
- Offset management integration with state backend
- Comprehensive metrics tracking
Structs§
- Kafka
Message - Message envelope with metadata
- Kafka
Source - Kafka source consumer for ingesting events
- Kafka
Source Config - Configuration for Kafka source consumer
- Kafka
Source Metrics - Metrics tracked by the Kafka source
Enums§
- Commit
Strategy - Commit strategy for offset management