Struct DeltaProviderScanExecutionOptions 

pub struct DeltaProviderScanExecutionOptions {
    pub reader_backend: DeltaProviderReaderBackend,
    pub max_concurrent_file_reads_per_scan: Option<usize>,
    pub max_concurrent_file_reads_per_partition: usize,
    pub output_buffer_capacity_per_partition: usize,
    pub native_async_prefetch_file_count_per_partition: usize,
}

Bounded scheduling options for one Delta DataFusion provider scan.

These limits apply to provider-scheduled physical Delta file reads. The official-kernel sync fallback limits a conservative file-level handoff: reading one file and sending its batches into the bounded DataFusion output channel. The native async reader preserves the same active-read semantics with async semaphore-style permits.

Fields

reader_backend: DeltaProviderReaderBackend

File-reader backend used by normal provider scan execution.

max_concurrent_file_reads_per_scan: Option<usize>

Maximum file-read handoffs that may run at once across the whole scan.

This is the scan-wide concurrency cap shared by all DataFusion execution partitions for one provider scan.

max_concurrent_file_reads_per_partition: usize

Maximum file-read handoffs that one execution partition may own at once.

This prevents a single DataFusion execution partition from consuming all scan-wide read capacity when multiple scan partitions are active.

output_buffer_capacity_per_partition: usize

Bounded output channel capacity for each DataFusion execution partition.

This is the producer-to-DataFusion handoff queue used after file reads produce Arrow batches. A value of 1 preserves the historical behavior.

native_async_prefetch_file_count_per_partition: usize

Native async file reads to prefetch ahead of downstream demand per partition.

A value of 0 keeps the native async backend fully lazy: each file is opened only after the previous file is drained. Positive values allow the native async backend to begin opening additional files while the current file is still producing batches. This setting is internal hardening and benchmark surface; the official-kernel backend ignores it.

Implementations

impl DeltaProviderScanExecutionOptions

pub fn try_new( max_concurrent_file_reads_per_scan: usize, max_concurrent_file_reads_per_partition: usize, ) -> Result<Self, DeltaFunnelError>

Builds validated Delta provider scan execution options.

pub fn try_new_with_reader_backend( reader_backend: DeltaProviderReaderBackend, max_concurrent_file_reads_per_scan: usize, max_concurrent_file_reads_per_partition: usize, ) -> Result<Self, DeltaFunnelError>

Builds validated Delta provider scan execution options with a reader backend.

pub fn with_output_buffer_capacity_per_partition( self, output_buffer_capacity_per_partition: usize, ) -> Result<Self, DeltaFunnelError>

Sets the per-partition bounded output buffer capacity.

pub fn with_native_async_prefetch_file_count_per_partition( self, native_async_prefetch_file_count_per_partition: usize, ) -> Result<Self, DeltaFunnelError>

Sets native async file-read prefetch depth per execution partition.

pub fn validate(&self) -> Result<(), DeltaFunnelError>

Validates provider scan execution bounds before registration or scan execution.

Trait Implementations

impl Clone for DeltaProviderScanExecutionOptions

fn clone(&self) -> DeltaProviderScanExecutionOptions

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for DeltaProviderScanExecutionOptions

impl Debug for DeltaProviderScanExecutionOptions

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for DeltaProviderScanExecutionOptions

fn default() -> Self

Returns the “default value” for a type.

impl Eq for DeltaProviderScanExecutionOptions

impl PartialEq for DeltaProviderScanExecutionOptions

fn eq(&self, other: &DeltaProviderScanExecutionOptions) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for DeltaProviderScanExecutionOptions