vortex_expr::transform::partition

Function partition

Source
pub fn partition(expr: ExprRef, dtype: &DType) -> VortexResult<PartitionedExpr>
Expand description

Partition an expression over the fields of the scope.

This returns a partitioned expression that can be push-down over each field of the scope. The results of each partition can then be recombined to reproduce the result of the original expression.

ยงNote

This function currently respects the validity of each field in the scope, but the not validity of the scope itself. The fix would be for the returned PartitionedExpr to include a partition expression for computing the validity, or to include that expression as part of the root.

See https://github.com/spiraldb/vortex/issues/1907.