Struct LiquidLinearArray 

pub struct LiquidLinearArray<T: LiquidPrimitiveType>
where
    T::Native: AsPrimitive<f64> + FromPrimitive + Bounded,
{ /* private fields */ }

A linear-model based integer array, only use it when you know the array is monotonic and you don’t care about encoding speed!.

Under the hood, it uses a linear model to predict the values and store the residuals: value[i] = intercept + round(slope * i) + residual[i]

Where intercept and slope are computed using a L-infinity linear fit, this is time-consuming!.

This array is only recommended if you know the array follows a linear model, e.g., kinetic values, offsets, etc.

Examples of not recommended use cases: random values like ids, categorical values, etc.

Implementations

impl<T> LiquidLinearArray<T>

where T: LiquidPrimitiveType, T::Native: AsPrimitive<f64> + FromPrimitive + Bounded,

pub fn from_arrow_array(arrow_array: PrimitiveArray<T>) -> Self

Build from an Arrow PrimitiveArray<T> by training a linear model using a fast L-infinity fit (Option 3) and storing residuals.

pub fn from_bytes(bytes: Bytes) -> Self

Decode a LiquidLinearArray<T> from bytes.

Trait Implementations

impl<T: Debug + LiquidPrimitiveType> Debug for LiquidLinearArray<T>

where T::Native: AsPrimitive<f64> + FromPrimitive + Bounded,

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<T> LiquidArray for LiquidLinearArray<T>

where T: LiquidPrimitiveType, T::Native: AsPrimitive<f64> + FromPrimitive + Bounded,

fn as_any(&self) -> &dyn Any

Get the underlying any type.

fn original_arrow_data_type(&self) -> DataType

Get the original arrow data type of the Liquid array.

fn get_array_memory_size(&self) -> usize

Get the memory size of the Liquid array.

fn len(&self) -> usize

Get the length of the Liquid array.

fn to_arrow_array(&self) -> ArrayRef

Convert the Liquid array to an Arrow array.

fn filter(&self, selection: &BooleanBuffer) -> ArrayRef

Filter the Liquid array with a boolean array and return an arrow array.

fn try_eval_predicate( &self, _predicate: &Arc<dyn PhysicalExpr>, _filter: &BooleanBuffer, ) -> Option<BooleanArray>

Try to evaluate a predicate on the Liquid array with a filter. Returns None if the predicate is not supported.

fn to_bytes(&self) -> Vec<u8>

Serialize the Liquid array to a byte array.

fn data_type(&self) -> LiquidDataType

Get the logical data type of the Liquid array.

fn is_empty(&self) -> bool

Check if the Liquid array is empty.

fn to_best_arrow_array(&self) -> ArrayRef

Convert the Liquid array to an Arrow array. Except that it will pick the best encoding for the arrow array. Meaning that it may not obey the data type of the original arrow array.

fn squeeze( &self, _io: Arc<dyn SqueezeIoHandler>, _expression_hint: Option<&CacheExpression>, ) -> Option<(LiquidSqueezedArrayRef, Bytes)>

Squeeze the Liquid array to a LiquidHybridArrayRef and a bytes::Bytes. Return None if the Liquid array cannot be squeezed.