Skip to main content

Module pipeline

Module pipeline 

Source
Expand description

Cascading codec pipeline: chains type-aware encoding → terminal compressor.

Each ColumnCodec variant maps to a fixed pipeline. The encode_pipeline() and decode_pipeline() functions dispatch to the appropriate chain.

Cascading chains:

  • AlpFastLanesLz4: f64 → ALP → FastLanes bit-pack → lz4
  • DeltaFastLanesLz4: i64 → Delta → FastLanes bit-pack → lz4
  • FastLanesLz4: i64 → FastLanes bit-pack → lz4

The pipeline writes a 1-byte codec ID header so the decoder knows which chain to reverse. This header is read by decode_pipeline().

Functions§

decode_bytes_pipeline
Decode raw bytes (symbol columns or string data) from a pipeline.
decode_f64_pipeline
Decode f64 values from a cascading pipeline.
decode_i64_pipeline
Decode i64 values from a cascading pipeline.
encode_bytes_pipeline
Encode raw bytes (symbol columns or string data) through a pipeline.
encode_f64_pipeline
Encode f64 values through a cascading pipeline.
encode_i64_pipeline
Encode i64 values through a cascading pipeline.