Struct datafusion::physical_plan::file_format::FileScanConfig

pub struct FileScanConfig {
    pub object_store: Arc<dyn ObjectStore>,
    pub file_schema: SchemaRef,
    pub file_groups: Vec<Vec<PartitionedFile>>,
    pub statistics: Statistics,
    pub projection: Option<Vec<usize>>,
    pub limit: Option<usize>,
    pub table_partition_cols: Vec<String>,
}

The base configurations to provide when creating a physical plan for any given file format.

Fields

object_store: Arc<dyn ObjectStore>

Store from which the files should be fetched

file_schema: SchemaRef

Schema before projection. It contains the columns that are expected to be in the files without the table partition columns.

file_groups: Vec<Vec<PartitionedFile>>

List of files to be processed, grouped into partitions

statistics: Statistics

Estimated overall statistics of the files, taking filters into account.

projection: Option<Vec<usize>>

Columns on which to project the data. Indexes that are higher than the number of columns of file_schema refer to table_partition_cols.

limit: Option<usize>

The minimum number of records required from this source plan

table_partition_cols: Vec<String>

The partitioning column names

Trait Implementations

impl Clone for FileScanConfig

fn clone(&self) -> FileScanConfig

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for FileScanConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.