Module arrow::compute

Computation kernels on Arrow Arrays

Re-exports

pub use self::kernels::aggregate::*;

pub use self::kernels::arithmetic::*;

pub use self::kernels::arity::*;

pub use self::kernels::boolean::*;

pub use self::kernels::comparison::*;

pub use self::kernels::limit::*;

pub use self::kernels::partition::*;

pub use self::kernels::regexp::*;

pub use self::kernels::sort::*;

pub use self::kernels::temporal::*;

pub use self::kernels::window::*;

Modules

kernels

Computation kernels on Arrow Arrays

Structs

CastOptions

CastOptions provides a way to override the default cast behaviors

FilterBuilder

A builder to construct FilterPredicate

FilterPredicate

A filtering predicate that can be applied to an Array

SlicesIterator

An iterator of (usize, usize) each representing an interval [start, end) whose slots of a BooleanArray are true. Each interval corresponds to a contiguous region of memory to be “taken” from an array to be filtered.

TakeOptions

Options that define how take should behave

Constants

DEFAULT_CAST_OPTIONS

Functions

build_filterDeprecated

Returns a prepared function optimized to filter multiple arrays. Creating this function requires time, but using it is faster than filter when the same filter needs to be applied to multiple arrays (e.g. a multi-column RecordBatch). WARNING: the nulls of filter are ignored and the value on its slot is considered. Therefore, it is considered undefined behavior to pass filter with null values.

can_cast_types

Return true if a value of type from_type can be cast into a value of to_type. Note that such as cast may be lossy.

cast

Cast array to the provided data type and return a new Array with type to_type, if possible.

cast_with_options

Cast array to the provided data type and return a new Array with type to_type, if possible. It accepts CastOptions to allow consumers to configure cast behavior.

concat

Concatenate multiple Array of the same type into a single ArrayRef.

concat_batches

Concatenates batches together into a single record batch.

filter

Filters an Array, returning elements matching the filter (i.e. where the values are true).

filter_record_batch

Returns a new RecordBatch with arrays containing only values matching the filter.

interleave

Takes elements by index from a list of Array, creating a new Array from those values.

prep_null_mask_filter

Remove null values by do a bitmask AND operation with null bits and the boolean bits.

take

Take elements by index from Array, creating a new Array from those indexes.

Type Definitions

FilterDeprecated

Function that can filter arbitrary arrays