Struct deltalake::datafusion::parquet::arrow::arrow_reader::ArrowReaderOptions

pub struct ArrowReaderOptions { /* private fields */ }

Options that control how metadata is read for a parquet file

See ArrowReaderBuilder for how to configure how the column data is then read from the file, including projection and filter pushdown

Implementations

impl ArrowReaderOptions

pub fn new() -> ArrowReaderOptions

Create a new ArrowReaderOptions with the default settings

pub fn with_skip_arrow_metadata( self, skip_arrow_metadata: bool ) -> ArrowReaderOptions

Parquet files generated by some writers may contain embedded arrow schema and metadata. This may not be correct or compatible with your system.

For example:ARROW-16184

Set skip_arrow_metadata to true, to skip decoding this

pub fn with_page_index(self, page_index: bool) -> ArrowReaderOptions

Set this true to enable decoding of the PageIndex if present. This can be used to push down predicates to the parquet scan, potentially eliminating unnecessary IO

Trait Implementations

impl Clone for ArrowReaderOptions

fn clone(&self) -> ArrowReaderOptions

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ArrowReaderOptions

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Default for ArrowReaderOptions

fn default() -> ArrowReaderOptions

Returns the “default value” for a type.