Struct datafusion::physical_plan::file_format::ParquetExec
source · [−]pub struct ParquetExec { /* private fields */ }
Expand description
Execution plan for scanning one or more Parquet partitions
Implementations
sourceimpl ParquetExec
impl ParquetExec
sourcepub fn new(base_config: FileScanConfig, predicate: Option<Expr>) -> Self
pub fn new(base_config: FileScanConfig, predicate: Option<Expr>) -> Self
Create a new Parquet reader execution plan provided file list and schema.
Even if limit
is set, ParquetExec rounds up the number of records to the next batch_size
.
sourcepub fn base_config(&self) -> &FileScanConfig
pub fn base_config(&self) -> &FileScanConfig
Ref to the base configs
Trait Implementations
sourceimpl Clone for ParquetExec
impl Clone for ParquetExec
sourcefn clone(&self) -> ParquetExec
fn clone(&self) -> ParquetExec
Returns a copy of the value. Read more
1.0.0 · sourcefn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from source
. Read more
sourceimpl Debug for ParquetExec
impl Debug for ParquetExec
sourceimpl ExecutionPlan for ParquetExec
impl ExecutionPlan for ParquetExec
sourcefn output_partitioning(&self) -> Partitioning
fn output_partitioning(&self) -> Partitioning
Get the output partitioning of this plan
sourcefn children(&self) -> Vec<Arc<dyn ExecutionPlan>>ⓘNotable traits for Vec<u8, A>impl<A> Write for Vec<u8, A> where
A: Allocator,
fn children(&self) -> Vec<Arc<dyn ExecutionPlan>>ⓘNotable traits for Vec<u8, A>impl<A> Write for Vec<u8, A> where
A: Allocator,
A: Allocator,
Get a list of child execution plans that provide the input for this plan. The returned list will be empty for leaf nodes, will contain a single value for unary nodes, or two values for binary nodes (such as joins). Read more
sourcefn output_ordering(&self) -> Option<&[PhysicalSortExpr]>
fn output_ordering(&self) -> Option<&[PhysicalSortExpr]>
If the output of this operator is sorted, returns Some(keys)
with the description of how it was sorted. Read more
sourcefn relies_on_input_order(&self) -> bool
fn relies_on_input_order(&self) -> bool
Returns true
if this operator relies on its inputs being
produced in a certain order (for example that they are sorted
a particular way) for correctness. Read more
sourcefn with_new_children(
&self,
children: Vec<Arc<dyn ExecutionPlan>>
) -> Result<Arc<dyn ExecutionPlan>>
fn with_new_children(
&self,
children: Vec<Arc<dyn ExecutionPlan>>
) -> Result<Arc<dyn ExecutionPlan>>
Returns a new plan where all children were replaced by new plans.
The size of children
must be equal to the size of ExecutionPlan::children()
. Read more
sourcefn execute<'life0, 'async_trait>(
&'life0 self,
partition_index: usize,
runtime: Arc<RuntimeEnv>
) -> Pin<Box<dyn Future<Output = Result<SendableRecordBatchStream>> + Send + 'async_trait>> where
'life0: 'async_trait,
Self: 'async_trait,
fn execute<'life0, 'async_trait>(
&'life0 self,
partition_index: usize,
runtime: Arc<RuntimeEnv>
) -> Pin<Box<dyn Future<Output = Result<SendableRecordBatchStream>> + Send + 'async_trait>> where
'life0: 'async_trait,
Self: 'async_trait,
creates an iterator
sourcefn fmt_as(&self, t: DisplayFormatType, f: &mut Formatter<'_>) -> Result
fn fmt_as(&self, t: DisplayFormatType, f: &mut Formatter<'_>) -> Result
Format this ExecutionPlan
to f
in the specified type. Read more
sourcefn metrics(&self) -> Option<MetricsSet>
fn metrics(&self) -> Option<MetricsSet>
Return a snapshot of the set of Metric
s for this
ExecutionPlan
. Read more
sourcefn statistics(&self) -> Statistics
fn statistics(&self) -> Statistics
Returns the global output statistics for this ExecutionPlan
node.
sourcefn required_child_distribution(&self) -> Distribution
fn required_child_distribution(&self) -> Distribution
Specifies the data distribution requirements of all the children for this operator Read more
sourcefn maintains_input_order(&self) -> bool
fn maintains_input_order(&self) -> bool
Returns false
if this operator’s implementation may reorder
rows within or between partitions. Read more
sourcefn benefits_from_input_partitioning(&self) -> bool
fn benefits_from_input_partitioning(&self) -> bool
Returns true
if this operator would benefit from
partitioning its input (and thus from more parallelism). For
operators that do very little work the overhead of extra
parallelism may outweigh any benefits Read more
Auto Trait Implementations
impl !RefUnwindSafe for ParquetExec
impl Send for ParquetExec
impl Sync for ParquetExec
impl Unpin for ParquetExec
impl !UnwindSafe for ParquetExec
Blanket Implementations
sourceimpl<T> BorrowMut<T> for T where
T: ?Sized,
impl<T> BorrowMut<T> for T where
T: ?Sized,
const: unstable · sourcepub fn borrow_mut(&mut self) -> &mut T
pub fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
sourceimpl<T> ToOwned for T where
T: Clone,
impl<T> ToOwned for T where
T: Clone,
type Owned = T
type Owned = T
The resulting type after obtaining ownership.
sourcepub fn to_owned(&self) -> T
pub fn to_owned(&self) -> T
Creates owned data from borrowed data, usually by cloning. Read more
sourcepub fn clone_into(&self, target: &mut T)
pub fn clone_into(&self, target: &mut T)
toowned_clone_into
)Uses borrowed data to replace owned data, usually by cloning. Read more