Expand description
Protobuf definitions for encodings
These are the messages used for describing encoding in the 2.0 format
Modules§
- array_
encoding - Nested message and enum types in
ArrayEncoding. - buffer
- Nested message and enum types in
Buffer. - column_
encoding - Nested message and enum types in
ColumnEncoding. - nullable
- Nested message and enum types in
Nullable.
Structs§
- Array
Encoding - Encodings that decode into an Arrow array
- Binary
- An array encoding for binary fields
- Bitpacked
- Items are bitpacked in a buffer
- Bitpacked
ForNon Neg - Items are bitpacked in a buffer
- Blob
- Marks a column as blob data. It will contain a packed struct with fields position and size (u64)
- Block
- Buffer
- A pointer to a buffer in a Lance file
- Byte
Stream Split - Byte Stream Split encoding for floating point values
- Column
Encoding - Encodings that describe a column of values
- Compression
- Constant
- Compression algorithm where all values have a constant value
- Dictionary
- An array encoding for dictionary-encoded fields
- Fixed
Size Binary - Fixed
Size List - An array encoding for fixed-size list fields
- Flat
- Fixed width items placed contiguously in a buffer
- Fsst
- General
Mini Block - General miniblock encoding - wraps another miniblock encoding with compression
- Inline
Bitpacking - Opaque bitpacking variant where the bits per value are stored inline in the chunks themselves
- List
- An array encoding for variable-length list fields
- Nullable
- An encoding that adds nullability to another array encoding
- OutOf
Line Bitpacking - Transparent bitpacking variant where the number of bits per value is fixed through the whole buffer
- Packed
Struct - Packed
Struct Fixed Width Mini Block - Rle
- Run-Length Encoding for miniblock format
- Simple
Struct - An array encoding for shredded structs that will never be null
- Variable
- Zone
Index - Wraps a column with a zone map index that can be used to apply pushdown filters