Skip to main content

Module pipeline

Module pipeline 

Source
Expand description

Push-based execution pipeline.

This module provides push-based execution primitives where data flows forward through operators via push() calls, enabling better parallelism and cache utilization compared to pull-based execution.

Structs§

ChunkCollector
Collects chunks from operators for intermediate processing.
Pipeline
Execution pipeline connecting source → operators → sink.

Enums§

ChunkSizeHint
Hint for preferred chunk size.

Constants§

DEFAULT_CHUNK_SIZE
Default chunk size in tuples.
LARGE_CHUNK_SIZE
Large chunk size for full scans.
SMALL_CHUNK_SIZE
Small chunk size for high selectivity or LIMIT.

Traits§

PushOperator
Push-based operator trait.
Sink
Sink that receives output from operators.
Source
Source of data chunks for a pipeline.