Struct datafusion::physical_plan::file_format::ParquetExec
source · [−]pub struct ParquetExec { /* private fields */ }
Expand description
Execution plan for scanning one or more Parquet partitions
Implementations
sourceimpl ParquetExec
impl ParquetExec
sourcepub fn new(
base_config: FileScanConfig,
predicate: Option<Expr>,
metadata_size_hint: Option<usize>
) -> Self
pub fn new(
base_config: FileScanConfig,
predicate: Option<Expr>,
metadata_size_hint: Option<usize>
) -> Self
Create a new Parquet reader execution plan provided file list and schema.
sourcepub fn base_config(&self) -> &FileScanConfig
pub fn base_config(&self) -> &FileScanConfig
Ref to the base configs
sourcepub fn pruning_predicate(&self) -> Option<&PruningPredicate>
pub fn pruning_predicate(&self) -> Option<&PruningPredicate>
Optional reference to this parquet scan’s pruning predicate
sourcepub fn with_parquet_file_reader_factory(
self,
parquet_file_reader_factory: Arc<dyn ParquetFileReaderFactory>
) -> Self
pub fn with_parquet_file_reader_factory(
self,
parquet_file_reader_factory: Arc<dyn ParquetFileReaderFactory>
) -> Self
Optional user defined parquet file reader factory.
ParquetFileReaderFactory
complements TableProvider
, It enables users to provide custom
implementation for data access operations.
If custom ParquetFileReaderFactory
is provided, then data access operations will be routed
to this factory instead of ObjectStore
.
Trait Implementations
sourceimpl Clone for ParquetExec
impl Clone for ParquetExec
sourcefn clone(&self) -> ParquetExec
fn clone(&self) -> ParquetExec
Returns a copy of the value. Read more
1.0.0 · sourcefn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from source
. Read more
sourceimpl Debug for ParquetExec
impl Debug for ParquetExec
sourceimpl ExecutionPlan for ParquetExec
impl ExecutionPlan for ParquetExec
sourcefn output_partitioning(&self) -> Partitioning
fn output_partitioning(&self) -> Partitioning
Get the output partitioning of this plan
sourcefn children(&self) -> Vec<Arc<dyn ExecutionPlan>>ⓘNotable traits for Vec<u8, A>impl<A> Write for Vec<u8, A>where
A: Allocator,
fn children(&self) -> Vec<Arc<dyn ExecutionPlan>>ⓘNotable traits for Vec<u8, A>impl<A> Write for Vec<u8, A>where
A: Allocator,
A: Allocator,
Get a list of child execution plans that provide the input for this plan. The returned list will be empty for leaf nodes, will contain a single value for unary nodes, or two values for binary nodes (such as joins). Read more
sourcefn output_ordering(&self) -> Option<&[PhysicalSortExpr]>
fn output_ordering(&self) -> Option<&[PhysicalSortExpr]>
If the output of this operator is sorted, returns Some(keys)
with the description of how it was sorted. Read more
sourcefn relies_on_input_order(&self) -> bool
fn relies_on_input_order(&self) -> bool
Returns true
if this operator relies on its inputs being
produced in a certain order (for example that they are sorted
a particular way) for correctness. Read more
sourcefn with_new_children(
self: Arc<Self>,
_: Vec<Arc<dyn ExecutionPlan>>
) -> Result<Arc<dyn ExecutionPlan>>
fn with_new_children(
self: Arc<Self>,
_: Vec<Arc<dyn ExecutionPlan>>
) -> Result<Arc<dyn ExecutionPlan>>
Returns a new plan where all children were replaced by new plans.
sourcefn execute(
&self,
partition_index: usize,
ctx: Arc<TaskContext>
) -> Result<SendableRecordBatchStream>
fn execute(
&self,
partition_index: usize,
ctx: Arc<TaskContext>
) -> Result<SendableRecordBatchStream>
creates an iterator
sourcefn fmt_as(&self, t: DisplayFormatType, f: &mut Formatter<'_>) -> Result
fn fmt_as(&self, t: DisplayFormatType, f: &mut Formatter<'_>) -> Result
Format this ExecutionPlan
to f
in the specified type. Read more
sourcefn metrics(&self) -> Option<MetricsSet>
fn metrics(&self) -> Option<MetricsSet>
Return a snapshot of the set of Metric
s for this
ExecutionPlan
. Read more
sourcefn statistics(&self) -> Statistics
fn statistics(&self) -> Statistics
Returns the global output statistics for this ExecutionPlan
node.
sourcefn required_child_distribution(&self) -> Distribution
fn required_child_distribution(&self) -> Distribution
Specifies the data distribution requirements of all the children for this operator Read more
sourcefn maintains_input_order(&self) -> bool
fn maintains_input_order(&self) -> bool
Returns false
if this operator’s implementation may reorder
rows within or between partitions. Read more
sourcefn benefits_from_input_partitioning(&self) -> bool
fn benefits_from_input_partitioning(&self) -> bool
Returns true
if this operator would benefit from
partitioning its input (and thus from more parallelism). For
operators that do very little work the overhead of extra
parallelism may outweigh any benefits Read more
Auto Trait Implementations
impl !RefUnwindSafe for ParquetExec
impl Send for ParquetExec
impl Sync for ParquetExec
impl Unpin for ParquetExec
impl !UnwindSafe for ParquetExec
Blanket Implementations
sourceimpl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
const: unstable · sourcefn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more