Expand description
Module containing helper methods/traits related to orchestrating file serialization, streaming to object store, parallelization, and abort handling
Functionsยง
- spawn_
writer_ tasks_ and_ join - Orchestrates multipart put of a dynamic number of output files from a single input stream for any statelessly serialized file type. That is, any file type for which each RecordBatch can be serialized independently of all other RecordBatchs.