Expand description
Kafka integration for stream processing pipeline
This module provides integration between Kafka and the stream processing pipeline, enabling Kafka-to-Kafka streaming with automatic offset management, watermarking, and error recovery.
Structsยง
- Kafka
Stream Config - Configuration for Kafka stream pipeline
- Kafka
Stream Pipeline - End-to-end Kafka stream processing pipeline
- Kafka
Stream Sink - Kafka stream sink that receives results from the pipeline
- Kafka
Stream Source - Kafka stream source that integrates with StreamExecutor
- Kafka
Stream Stats - Statistics for Kafka stream processing
- Offset
Manager - Offset manager for tracking and committing Kafka offsets