Skip to main content

Module dtype

Module dtype 

Source
Expand description

Convert between Vortex vortex_array::dtype::DType and Apache Arrow arrow_schema::DataType.

Apache Arrow’s type system includes physical information, which could lead to ambiguities as Vortex treats encodings as separate from logical types.

DType::to_arrow_schema and its sibling DType::to_arrow_dtype use a simple algorithm, where every logical type is encoded in its simplest corresponding Arrow type. This reflects the reality that most compute engines don’t make use of the entire type range arrow-rs supports.

For this reason, it’s recommended to do as much computation as possible within Vortex, and then materialize an Arrow ArrayRef at the very end of the processing chain.

Traits§

FromArrowType
Trait for converting Arrow types to Vortex types.
ToArrowType
Extension trait converting Vortex DTypes into Arrow schemas and data types.
TryFromArrowType
Trait for converting Vortex types to Arrow types.

Functions§

to_arrow_time_unit
Convert a Vortex TimeUnit to an Arrow ArrowTimeUnit.