Skip to main content

Module chunker

lance_datafusion

Module chunker 

Source

Structs§

StrictBatchSizeStream
Given a stream of record batches, this will yield batches of a fixed size.

Functions§

break_stream
break_stream_with_sizes
Preserve input batch boundaries while inserting the requested row boundaries.
chunk_concat_stream
Given a stream of record batches, this will yield batches of a fixed size.
chunk_stream
Given a stream of record batches, this will yield batches of a fixed size.
chunk_stream_with_sizes
Given a stream of record batches, yield chunks with the requested row counts.