Struct PartitionScanner 

pub struct PartitionScanner<S> { /* private fields */ }

Streaming scanner that splits sorted input batches into partition chunks.

Implementations

impl<S: BatchSource> PartitionScanner<S>

pub fn new(source: S, key_columns: Vec<usize>) -> Result<Self>

Create a scanner over batches that are already ordered by partition key.

key_columns are indexes in each projected RecordBatch. An empty key list treats the full input stream as a single partition.

pub fn next_chunk(&mut self) -> Result<Option<PartitionChunk>>

Return the next partition chunk with start/end boundary markers.

pub fn for_each_partition<F>(&mut self, visit: F) -> Result<()>

where F: FnMut(Partition<'_>) -> Result<()>,

Invoke visit once per logical partition.

The partition view owns chunk descriptors. Row data remains shared with the underlying batches, so callers can evaluate window or rolling logic without copying whole partitions.