pub fn chunk_stream(
stream: SendableRecordBatchStream,
chunk_size: usize,
) -> Pin<Box<dyn Stream<Item = Result<Vec<RecordBatch>>> + Send>>Expand description
Given a stream of record batches, this will yield batches of a fixed size.
In order to avoid copying data the batches will be converted into a stream of
Vec<RecordBatch> where each item is a Vec of batches whose total size is
chunk_size.