Crate re_arrow_util 

Helpers for working with arrow

Structs

MissingColumnError

Error used when a column is missing from a record batch

RecordBatchFormatOpts

WrongDatatypeError

Error used for arrow datatype mismatch.

Traits

ArrowArrayDowncastRef

Downcast an arrow array to another array, without having to go via Any.

FieldsTestExt

RecordBatchExt

RecordBatchTestExt

SchemaTestExt

Functions

almost_equal_f64

Return true when arguments are the same within some rounding error.

arrays_to_list_array

Create a sparse list-array out of an array of arrays.

arrays_to_list_array_opt

Create a sparse list-array out of an array of arrays.

blob_arrays_offsets_and_buffer

Get the underlying buffer of an arrow array of logical type Vec<Vec<Blob>>.

concat_arrays

Applies a arrow::compute::concat kernel to the given arrays.

concat_polymorphic_batches

Concatenates the given RecordBatches, regardless of their respective schema.

deep_slice_array

Deep-slicing operation for Arrow arrays.

deep_slice_array_erased

Deep-slicing operation for Arrow arrays.

ensure_similar

Are two arrays equal, ignoring small numeric differences?

extract_fixed_size_array_element

Extract the element at idx from a FixedSizeListArray.

filter_array

Applies a filter kernel to the given array.

format_data_type

Compact format of an arrow data type.

format_field_datatype

Format the datatype of a field (column) with optional nullability

format_record_batch

Nicely format this record batch in a way that fits the terminal.

format_record_batch_opts

Nicely format this record batch using the specified options.

format_record_batch_with_width

Nicely format this record batch, either with the given fixed width, or with the terminal width (None).

garbage_collect_string_view_batch

Heuristically compact StringViewArrays to reduce memory usage, if needed

into_arrow_ref

is_list_array_semantically_empty

Returns true if the given list_array is semantically empty.

new_list_array_of_empties

Returns a new [ListArray] with len entries.

pad_list_array_back

Create a new ListArray of target length by appending null values to its back.

pad_list_array_front

Create a new ListArray of target length by appending null values to its front.

sparse_list_array_to_dense_list_array

Given a sparse ListArray (i.e. an array with a nulls bitmap that contains at least one falsy value), returns a dense ListArray that only contains the non-null values from the original list.

take_array

Applies a take kernel to the given array.

widen_binary_arrays

Convert any BinaryArray to LargeBinaryArray, because we treat them logically the same

wrap_in_list_array

Convert [A, B, null, D, …] into [[A], [B], null, [D], …].