Expand description
Convert between Vortex vortex_array::dtype::DType and Apache Arrow arrow_schema::DataType.
Apache Arrow’s type system includes physical information, which could lead to ambiguities as Vortex treats encodings as separate from logical types.
DType::to_arrow_schema and its sibling DType::to_arrow_dtype use a simple algorithm,
where every logical type is encoded in its simplest corresponding Arrow type. This reflects the
reality that most compute engines don’t make use of the entire type range arrow-rs supports.
For this reason, it’s recommended to do as much computation as possible within Vortex, and then materialize an Arrow ArrayRef at the very end of the processing chain.
Traits§
- From
Arrow Type - Trait for converting Arrow types to Vortex types.
- ToArrow
Type - Extension trait converting Vortex
DTypes into Arrow schemas and data types. - TryFrom
Arrow Type - Trait for converting Vortex types to Arrow types.
Functions§
- to_
arrow_ time_ unit - Convert a Vortex
TimeUnitto an ArrowArrowTimeUnit.