Skip to main content

Module stream

lance_arrow

Module stream 

Source
Expand description

Utilities for working with streams of RecordBatch.

Functionsยง

rechunk_stream_by_size
Rechunks a stream of RecordBatch so that each output batch has approximately target_bytes of array data.
rechunk_stream_by_size_deep_copy
Like rechunk_stream_by_size but deep-copies slices so that get_array_memory_size reflects the true size of each output batch.