Struct ZstdArray 

pub struct ZstdArray { /* private fields */ }

Implementations

impl ZstdArray

pub fn to_array(&self) -> ArrayRef

👎Deprecated: use .into_array() (owned) or .clone().into_array() (ref) to make clones explicit

impl ZstdArray

pub fn new( dictionary: Option<ByteBuffer>, frames: Vec<ByteBuffer>, dtype: DType, metadata: ZstdMetadata, n_rows: usize, validity: Validity, ) -> Self

pub fn from_primitive( parray: &PrimitiveArray, level: i32, values_per_frame: usize, ) -> VortexResult<Self>

Creates a ZstdArray from a primitive array.

Arguments

• parray - The primitive array to compress
• level - Zstd compression level (0 = default, negative = fast, positive = better compression)
• values_per_frame - Number of values per frame (0 = single frame)

pub fn from_primitive_without_dict( parray: &PrimitiveArray, level: i32, values_per_frame: usize, ) -> VortexResult<Self>

Creates a ZstdArray from a primitive array without using a dictionary.

This is useful when the compressed data will be decompressed by systems that don’t support ZSTD dictionaries (e.g., nvCOMP on GPU).

Note: Without a dictionary, each frame is compressed independently. Dictionaries are trained from sample data from previously seen frames, to improve compression ratio.

Arguments

• parray - The primitive array to compress
• level - Zstd compression level (0 = default, negative = fast, positive = better compression)
• values_per_frame - Number of values per frame (0 = single frame)

pub fn from_var_bin_view( vbv: &VarBinViewArray, level: i32, values_per_frame: usize, ) -> VortexResult<Self>

Creates a ZstdArray from a VarBinView array.

Arguments

• vbv - The VarBinView array to compress
• level - Zstd compression level (0 = default, negative = fast, positive = better compression)
• values_per_frame - Number of values per frame (0 = single frame)

pub fn from_var_bin_view_without_dict( vbv: &VarBinViewArray, level: i32, values_per_frame: usize, ) -> VortexResult<Self>

Creates a ZstdArray from a VarBinView array without using a dictionary.

This is useful when the compressed data will be decompressed by systems that don’t support ZSTD dictionaries (e.g., nvCOMP on GPU).

Note: Without a dictionary, each frame is compressed independently. Dictionaries are trained from sample data from previously seen frames, to improve compression ratio.

Arguments

• vbv - The VarBinView array to compress
• level - Zstd compression level (0 = default, negative = fast, positive = better compression)
• values_per_frame - Number of values per frame (0 = single frame)

pub fn from_canonical( canonical: &Canonical, level: i32, values_per_frame: usize, ) -> VortexResult<Option<Self>>

pub fn from_array( array: ArrayRef, level: i32, values_per_frame: usize, ) -> VortexResult<Self>

pub fn decompress(&self) -> VortexResult<ArrayRef>

pub fn into_parts(self) -> ZstdArrayParts

Consumes the array and returns its parts.

Trait Implementations

impl AsRef<dyn DynArray> for ZstdArray

fn as_ref(&self) -> &dyn DynArray

Converts this type into a shared reference of the (usually inferred) input type.

impl Clone for ZstdArray

fn clone(&self) -> ZstdArray

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ZstdArray

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Deref for ZstdArray

type Target = dyn DynArray

The resulting type after dereferencing.

fn deref(&self) -> &Self::Target

Dereferences the value.

impl From<ZstdArray> for ArrayRef

fn from(value: ZstdArray) -> ArrayRef

Converts to this type from the input type.

impl IntoArray for ZstdArray

fn into_array(self) -> ArrayRef

impl ValiditySliceHelper for ZstdArray

fn unsliced_validity_and_slice(&self) -> (&Validity, usize, usize)

fn sliced_validity(&self) -> Result<Validity, VortexError>