Module datafusion::physical_plan

Traits for physical query plan, supporting parallel execution for partitioned relations.

Modules

aggregates	Declaration of built-in (aggregate) functions. This module contains built-in aggregates' enumeration and metadata.
array_expressions	Array expressions
coalesce_batches	CoalesceBatchesExec combines small batches into larger batches for more efficient use of vectorized processing by upstream operators.
common	Defines common code used in execution plans
crypto_expressions	Crypto expressions
csv	Execution plan for reading CSV files
datetime_expressions	DateTime expressions
distinct_expressions	Implementations for DISTINCT expressions, e.g. COUNT(DISTINCT c)
empty	EmptyRelation execution plan
explain	Defines the EXPLAIN operator
expressions	Defines physical expressions that can evaluated at runtime during query execution
filter	FilterExec evaluates a boolean predicate against all input batches to determine which rows to include in its output batches.
functions	Declaration of built-in (scalar) functions. This module contains built-in functions' enumeration and metadata.
group_scalar	Defines scalars used to construct groups, ex. in GROUP BY clauses.
hash_aggregate	Defines the execution plan for the hash aggregate operation
hash_join	Defines the join plan for executing partitions in parallel and then joining the results into a set of partitions.
hash_utils	Functionality used both on logical and physical plans
limit	Defines the LIMIT plan
math_expressions	Math expressions
memory	Execution plan for reading in-memory batches of data
merge	Defines the merge plan for executing partitions in parallel and then merging the results into a single partition
parquet	Execution plan for reading Parquet files
planner	Physical query planner
projection	Defines the projection execution plan. A projection determines which columns or expressions are returned from a query. The SQL statement SELECT a, b, a+b FROM t1 is an example of a projection on table t1 where the expressions a, b, and a+b are the projection expressions. SELECT without FROM will only evaluate expressions.
repartition	The repartition operator maps N input partitions to M output partitions based on a partitioning scheme.
sort	Defines the SORT plan
string_expressions	String expressions
type_coercion	Type coercion rules for functions with multiple valid signatures
udaf	This module contains functions and structs supporting user-defined aggregate functions.
udf	UDF support

Enums

ColumnarValue	Represents the result from an expression
Distribution	Distribution schemes
Partitioning	Partitioning schemes supported by operators.

Traits

Accumulator	An accumulator represents a stateful object that lives throughout the evaluation of multiple rows and generically accumulates values. An accumulator knows how to:
AggregateExpr	An aggregate expression that:
ExecutionPlan	Partition-aware execution plan for a relation
PhysicalExpr	Expression that can be evaluated against a RecordBatch A Physical expression knows its type, nullability and how to evaluate itself.
PhysicalPlanner	Physical query planner that converts a LogicalPlan to an ExecutionPlan suitable for execution.
RecordBatchStream	Trait for types that stream arrow::record_batch::RecordBatch

Functions

collect	Execute the ExecutionPlan and collect the results in memory
collect_partitioned	Execute the ExecutionPlan and collect the results in memory

Type Definitions

SendableRecordBatchStream

Trait for a stream of record batches.