Struct lance_encoding::encoder::EncodedBuffer

pub struct EncodedBuffer {
    pub is_data: bool,
    pub parts: Vec<Buffer>,
}

An encoded buffer

Fields

is_data: bool

If true, the buffer should be stored as “data” If false, the buffer should be stored as “metadata”

Metadata buffers are typically small buffers that should be cached. For example, this might be a small dictionary when data has been dictionary encoded. Or it might contain a skip block when data has been RLE encoded.

parts: Vec<Buffer>

Buffers that make up the encoded buffer

All of these buffers should be written to the file as one contiguous buffer

This is a Vec to allow for zero-copy

For example, if we are asked to write 3 primitive arrays of 1000 rows and we can write them all as one page then this will be the value buffers from the 3 primitive arrays

Trait Implementations

impl Debug for EncodedBuffer

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.