Struct LayoutReaderDataSource 

pub struct LayoutReaderDataSource { /* private fields */ }

An implementation of a DataSource that reads data from a LayoutReaderRef.

Implementations

impl LayoutReaderDataSource

pub fn new(reader: LayoutReaderRef, session: VortexSession) -> Self

Creates a new LayoutReaderDataSource.

By default, the entire scan is returned as a single split. This best preserves V1 ScanBuilder behavior where one scan covers the full row range, allowing the internal I/O pipeline and SplitBy::Layout chunking to operate without per-split overhead from redundant expression resolution and layout tree traversal.

pub fn with_split_max_row_count(self, row_count: u64) -> Self

Sets the maximum number of rows per Scan API split.

Each split drives a ScanBuilder over its row range, which internally handles physical layout alignment and I/O pipelining. This controls the engine-level parallelism granularity, not the I/O granularity.

pub fn with_metrics_registry(self, metrics: Arc<dyn MetricsRegistry>) -> Self

Sets the metrics registry for tracking scan performance.

pub fn with_some_metrics_registry( self, metrics: Option<Arc<dyn MetricsRegistry>>, ) -> Self

Optionally sets the metrics registry for tracking scan performance.

Trait Implementations

impl DataSource for LayoutReaderDataSource

fn dtype(&self) -> &DType

Returns the dtype of the source.

fn row_count(&self) -> Option<Precision<u64>>

Returns an estimate of the row count of the un-filtered source.

fn byte_size(&self) -> Option<Precision<u64>>

Returns an estimate of the byte size of the un-filtered source.

fn deserialize_partition( &self, _data: &[u8], _session: &VortexSession, ) -> VortexResult<PartitionRef>

Deserialize a partition that was previously serialized from a compatible data source.

fn scan<'life0, 'async_trait>( &'life0 self, scan_request: ScanRequest, ) -> Pin<Box<dyn Future<Output = VortexResult<DataSourceScanRef>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Returns a scan over the source.

fn field_statistics<'life0, 'life1, 'async_trait>( &'life0 self, _field_path: &'life1 FieldPath, ) -> Pin<Box<dyn Future<Output = VortexResult<StatsSet>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Returns the statistics for a given field.

fn serialize(&self) -> VortexResult<Option<Vec<u8>>>

Serialize the DataSource to pass to a remote worker.