Crate vortex

Vortex crate containing core logic for encoding and memory representation of arrays.

At the heart of Vortex are arrays and encodings. Arrays are typed views of memory buffers that hold scalars. These buffers can be held in a number of physical encodings to perform lightweight compression that exploits the particular data distribution of the array’s values.

Every data type recognized by Vortex also has a canonical physical encoding format, which arrays can be canonicalized into for ease of access in compute functions.

Re-exports

• pub use ::paste;

Modules

• accessor
• array
• arrow
• compress
• compute
  Compute kernels on top of Vortex Arrays.
• encoding
• flatbuffers
• iter
• stats
• stream
• validity
• variants
• vendored
• visitor

Macros

• impl_encoding

Structs

• ArrayChildrenIterator
  A depth-first pre-order iterator over a ArrayData.
• ArrayData
• ArrayView
• ChildrenCollector
• Context
• TypedArray

Enums

• Array
• Canonical
  The set of canonical array encodings, also the set of encodings that can be transferred to Arrow with zero-copy.

Traits

• ArrayDType
• ArrayDef
  Trait the defines the set of types relating to an array. Because it has associated types it can’t be used as a trait object.
• ArrayLen
• ArrayMetadata
  Dynamic trait used to represent opaque owned Array metadata Note that this allows us to restrict the (’static + Send + Sync) requirement to just the metadata trait, and not the entire array trait. We require ’static so that we can downcast use the Any trait. TODO(ngates): add Display
• ArrayTrait
  Collects together the behaviour of an array.
• AsArray
• GetArrayMetadata
• IntoArray
• IntoArrayVariant
  Trait for types that can be converted from an owned type into an owned array variant.
• IntoCanonical
  Support trait for transmuting an array into its vortex_dtype::DType’s canonical encoding.
• ToArray
• TryDeserializeArrayMetadata
• TrySerializeArrayMetadata