Struct parquet::encoding::DeltaLengthByteArrayEncoder

pub struct DeltaLengthByteArrayEncoder<T: DataType> { /* fields omitted */ }

Encoding for byte arrays to separate the length values and the data. The lengths are encoded using DELTA_BINARY_PACKED encoding, data is stored as raw bytes.

Methods

impl<T: DataType> DeltaLengthByteArrayEncoder<T>

pub fn new() -> Self

Creates new delta length byte array encoder.

Trait Implementations

impl Encoder<ByteArrayType> for DeltaLengthByteArrayEncoder<ByteArrayType>

fn put(&mut self, values: &[ByteArray]) -> Result<()>

Encodes data from values.

fn flush_buffer(&mut self) -> Result<ByteBufferPtr>

Flushes the underlying byte buffer that's being processed by this encoder, and return the immutable copy of it. This will also reset the internal state.

fn put_spaced(&mut self, values: &[T::T], valid_bits: &[u8]) -> Result<usize>

Encodes data from values, which contains spaces for null values, that is identified by valid_bits.

fn encoding(&self) -> Encoding

Returns the encoding type of this encoder.

fn estimated_data_encoded_size(&self) -> usize

Returns an estimate of the encoded data, in bytes. Method call must be O(1).

impl<T: DataType> Encoder<T> for DeltaLengthByteArrayEncoder<T>

default fn put(&mut self, _values: &[T::T]) -> Result<()>

Encodes data from values.

fn encoding(&self) -> Encoding

Returns the encoding type of this encoder.

fn estimated_data_encoded_size(&self) -> usize

Returns an estimate of the encoded data, in bytes. Method call must be O(1).

default fn flush_buffer(&mut self) -> Result<ByteBufferPtr>

Flushes the underlying byte buffer that's being processed by this encoder, and return the immutable copy of it. This will also reset the internal state.

fn put_spaced(&mut self, values: &[T::T], valid_bits: &[u8]) -> Result<usize>

Encodes data from values, which contains spaces for null values, that is identified by valid_bits.