Trait SourceLane 

pub trait SourceLane: Send {
    type Batch<'a>: PayloadBatch<'a>
       where Self: 'a;

    // Required methods
    fn id(&self) -> LaneId;
    fn partition(&self) -> PartitionId;
    fn poll(
        &mut self,
        max_records: usize,
        timeout: Duration,
    ) -> Result<Option<Self::Batch<'_>>, SourceError>;
}

Data-plane pollable unit of a source, owned by one pipeline thread.

Contract: payloads yielded by SourceLane::poll are valid only until the returned batch is dropped, which happens before the next poll call on the same lane. Records must be consumed or encoded within that window (the operator chain guarantees this by construction).

Required Associated Types

type Batch<'a>: PayloadBatch<'a> where Self: 'a

The borrowed batch type (a GAT so payloads can borrow lane buffers).

Required Methods

fn id(&self) -> LaneId

This lane’s identity within the current assignment.

fn partition(&self) -> PartitionId

The source partition this lane reads. Used for checkpoint issuing and shard routing fallback.

fn poll( &mut self, max_records: usize, timeout: Duration, ) -> Result<Option<Self::Batch<'_>>, SourceError>

Poll up to max_records payloads, waiting at most timeout. Ok(None) means nothing arrived; the driver treats it as idle. Implementations must not busy-spin when idle; block up to timeout.

Dyn Compatibility

This trait is not dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Implementations on Foreign Types

impl SourceLane for DatagenLane

type Batch<'a> = DatagenBatch<'a>

fn id(&self) -> LaneId

fn partition(&self) -> PartitionId

fn poll( &mut self, max_records: usize, timeout: Duration, ) -> Result<Option<DatagenBatch<'_>>, SourceError>

impl SourceLane for KafkaLane

type Batch<'a> = KafkaBatch<'a>

fn id(&self) -> LaneId

fn partition(&self) -> PartitionId

fn poll( &mut self, max_records: usize, timeout: Duration, ) -> Result<Option<<KafkaLane as SourceLane>::Batch<'_>>, SourceError>

impl SourceLane for S3Lane

type Batch<'a> = S3Batch<'a>

fn id(&self) -> LaneId

fn partition(&self) -> PartitionId

fn poll( &mut self, max_records: usize, timeout: Duration, ) -> Result<Option<S3Batch<'_>>, SourceError>

Implementors