Skip to main content

Module reader

Module reader 

Source
Expand description

Segment reader: decode compressed columns from a segment into typed vectors or Arrow arrays, with column projection and block predicate pushdown.

§Block Wire Format

Each block in a column is stored as [compressed_len: u32 LE][compressed_data].

The compressed_data structure depends on the column type:

  • Int64/Float64/Timestamp: [validity_bitmap][codec_compressed_values]
  • Bool/Decimal/Uuid/Vector: [validity_bitmap][codec_compressed_bytes]
  • String/Bytes/Geometry: [validity_bitmap][offset_len: u32][compressed_offsets][compressed_data]

Structs§

SegmentReader
Reads and decodes columns from a segment byte buffer.

Enums§

DecodedColumn
Decoded column data from a segment scan.