Crate re_arrow_util 

Helpers for working with arrow

Structs

DowncastError

A failed downcast of an arrow array to a concrete array type.

MissingColumnError

Error used when a column is missing from a record batch

RecordBatchFormatOpts

WrongDatatypeError

Error used for arrow datatype mismatch.

Enums

GetColumnError

Error used when a column is missing from a record batch, or has the wrong type.

Traits

ArrowArrayDowncastRef

Downcast an arrow array to another array, without having to go via Any.

FieldsTestExt

ListArrayExt

Extensions for GenericListArray.

RecordBatchExt

RecordBatchTestExt

SchemaTestExt

Functions

almost_equal_f64

Return true when arguments are the same within some rounding error.

arrays_to_list_array

Create a sparse list-array out of an array of arrays.

arrays_to_list_array_opt

Create a sparse list-array out of an array of arrays.

blob_array_to_binary

Returns a binary-array view of blob data represented as BinaryArray or ListArray<UInt8>.

blob_arrays_offsets_and_buffer

Get the underlying buffer of an arrow array of logical type Vec<Vec<Blob>>.

canonical_component_list_field

The canonical field for the outer list of a component column: named item, nullable, and without metadata.

canonicalized_component_list_array

Rewrites list_array’s outer field into canonical_component_list_field, leaving the values, offsets and nulls untouched. Returns None if the field is already canonical.

concat_arrays

Applies a arrow::compute::concat kernel to the given arrays.

concat_polymorphic_batches

Concatenates the given RecordBatches, regardless of their respective schema.

deep_slice_array

Deep-slicing operation for Arrow arrays.

deep_slice_array_erased

Deep-slicing operation for Arrow arrays.

ensure_similar

Are two arrays equal, ignoring small numeric differences?

extract_fixed_size_array_element

Extract the element at idx from a FixedSizeListArray.

filter_array

Applies a filter kernel to the given array.

format_field_datatype

Format the datatype of a field (column) with optional nullability

format_record_batch

Nicely format this record batch in a way that fits the terminal.

format_record_batch_opts

Nicely format this record batch using the specified options.

format_record_batch_with_width

Nicely format this record batch, either with the given fixed width, or with the terminal width (None).

garbage_collect_string_view_batch

Heuristically compact StringViewArrays to reduce memory usage, if needed

into_arrow_ref

is_list_array_semantically_empty

Returns true if the given list_array is semantically empty.

new_list_array_of_empties

Returns a new [ListArray] with len entries.

pad_list_array_back

Create a new ListArray of target length by appending null values to its back.

pad_list_array_front

Create a new ListArray of target length by appending null values to its front.

reject_unsupported_widenings

Safety gate: reject DataType::Union in the checked type, and recursively within nested DataType::Struct, DataType::List, DataType::LargeList, and DataType::FixedSizeList children.

sparse_list_array_to_dense_list_array

Given a sparse ListArray (i.e. an array with a nulls bitmap that contains at least one falsy value), returns a dense ListArray that only contains the non-null values from the original list.

take_array

Applies a take kernel to the given array.

take_record_batch

Takes rows from a RecordBatch at the specified indices.

widen_binary_arrays

Convert any BinaryArray to LargeBinaryArray, because we treat them logically the same

wrap_in_list_array

Convert [A, B, null, D, …] into [[A], [B], null, [D], …].