Crate vortex_btrblocks 

Vortex’s BtrBlocks-inspired adaptive compression framework.

This crate provides a sophisticated multi-level compression system that adaptively selects optimal compression schemes based on data characteristics. The compressor analyzes arrays to determine the best encoding strategy, supporting cascaded compression with multiple encoding layers for maximum efficiency.

Key Features

• Adaptive Compression: Automatically selects the best compression scheme based on data patterns
• Type-Specific Compressors: Specialized compression for integers, floats, strings, and temporal data
• Cascaded Encoding: Multiple compression layers can be applied for optimal results
• Statistical Analysis: Uses data sampling and statistics to predict compression ratios
• Recursive Structure Handling: Compresses nested structures like structs and lists

Example

use vortex_btrblocks::{BtrBlocksCompressor, BtrBlocksCompressorBuilder, IntCode};
use vortex_array::Array;

// Default compressor with all schemes enabled
let compressor = BtrBlocksCompressor::default();

// Configure with builder to exclude specific schemes
let compressor = BtrBlocksCompressorBuilder::default()
    .exclude_int([IntCode::Dict])
    .build();

Structs

BtrBlocksCompressor

The main compressor type implementing BtrBlocks-inspired compression.

BtrBlocksCompressorBuilder

Builder for creating configured BtrBlocksCompressor instances.

GenerateStatsOptions

Configures how stats are generated.

IntegerStats

Array of integers and relevant stats for compression.

Enums

FloatCode

Unique identifier for float compression schemes.

IntCode

Unique identifier for integer compression schemes.

StringCode

Unique identifier for string compression schemes.

Traits

CanonicalCompressor

Trait for compressors that can compress canonical arrays.

CompressorStats

Stats for the compressor.

Functions

integer_dictionary_encode

Compresses an integer array into a dictionary arrays according to attached stats.