Skip to main content

compile_transforms_columnar

Function compile_transforms_columnar 

Source
pub fn compile_transforms_columnar(
    specs: &[TransformSpec],
) -> CliResult<(Vec<TransformStage>, Vec<Option<PageFnBatchBox>>)>
Available on crate feature arrow only.
Expand description

Like compile_transforms but also returns each stage’s Arrow RecordBatch form (parallel to the stages), so the executor can build a columnar-capable TransformingSource (#375). Only the sql transform supplies a batch form today; every other stage’s entry is None, which keeps the whole chain on the Value path unless every stage is columnar.