Struct BlobStructuralEncoder 

pub struct BlobStructuralEncoder { /* private fields */ }

Blob structural encoder - stores large binary data in external buffers

This encoder takes large binary arrays and stores them outside the normal page structure. It creates a descriptor (position, size) for each blob that is stored inline in the page.

Implementations

impl BlobStructuralEncoder

pub fn new( field: &Field, column_index: u32, options: &EncodingOptions, compression_strategy: Arc<dyn CompressionStrategy>, ) -> Result<Self>

Trait Implementations

impl FieldEncoder for BlobStructuralEncoder

fn maybe_encode( &mut self, array: ArrayRef, external_buffers: &mut OutOfLineBuffers, repdef: RepDefBuilder, row_number: u64, num_rows: u64, ) -> Result<Vec<EncodeTask>>

Buffer the data and, if there is enough data in the buffer to form a page, return an encoding task to encode the data.

fn flush( &mut self, external_buffers: &mut OutOfLineBuffers, ) -> Result<Vec<EncodeTask>>

Flush any remaining data from the buffers into encoding tasks

fn finish( &mut self, external_buffers: &mut OutOfLineBuffers, ) -> BoxFuture<'_, Result<Vec<EncodedColumn>>>

Finish encoding and return column metadata

fn num_columns(&self) -> u32

The number of output columns this encoding will create