Crate vortex_fsst

An array that uses the Fast Static Symbol Table compression scheme to compress string arrays.

FSST arrays can generally compress string data up to 2x through the use of string tables. The string table is static for an entire array, and occupies up to 2048 bytes of buffer space. Thus, FSST is only worth reaching for when dealing with larger arrays of potentially hundreds of kilobytes or more.

Structs

FSSTArray

FSSTEncoding

FSSTVTable

Functions

fsst_compress

Compress an array using FSST.

fsst_compress_iter

Compress from an iterator of bytestrings using FSST.

fsst_train_compressor

Train a compressor from an array.