Struct KafkaStreamSource 

pub struct KafkaStreamSource<T>
where
    T: Clone + Send + Sync + 'static,
{ /* private fields */ }

Kafka stream source that integrates with StreamExecutor

This component polls messages from Kafka and feeds them into the stream processing pipeline. It handles:

• Message deserialization
• Event time extraction
• Watermark generation
• Offset tracking

Implementations

impl<T> KafkaStreamSource<T>

where T: Clone + Send + Sync + 'static + Serialize + for<'de> Deserialize<'de>,

pub fn new( consumer: Arc<StreamConsumer>, topics: Vec<String>, executor: Arc<StreamExecutor<T>>, offset_manager: Arc<OffsetManager>, stats: Arc<RwLock<KafkaStreamStats>>, poll_timeout: Duration, ) -> Self

Create a new Kafka stream source

pub async fn run(&self) -> Result<()>

where T: EventTimeExtractor<T> + KeyExtractor<T>,

Start consuming messages and feeding them to the executor

pub fn stop(&self)

Stop the source

pub fn is_running(&self) -> bool

Check if running

pub async fn stats(&self) -> KafkaStreamStats

Get statistics

Trait Implementations

impl<T> Clone for KafkaStreamSource<T>

where T: Clone + Send + Sync + 'static,

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.