blockchain-compression

Lossless compression for blockchain data -- up to 60:1 ratios with Zstandard and custom dictionaries, built in Rust.

Why blockchain-compression?

Blockchain data is full of repeated structures -- program IDs, public keys, signatures, common amounts -- that general-purpose compressors don't exploit. This library uses Zstandard with custom dictionaries trained on blockchain-specific byte patterns to achieve dramatically better compression ratios while guaranteeing perfect data integrity.

Quick Start

Add to your Cargo.toml:

[dependencies]
blockchain-compression = { version = "0.1", features = ["zstd"] }

Compress and decompress:

use blockchain_compression::presets::solana::{SolanaCompressor, SolanaPreset};
use blockchain_compression::core::traits::CompressionStrategy;

let mut compressor = SolanaCompressor::new(SolanaPreset::Transactions);

let compressed = compressor.compress(data)?;
let decompressed = compressor.decompress(&compressed)?;
assert_eq!(data, decompressed.as_slice());

Features

• Blockchain-optimized dictionaries -- custom Zstandard dictionaries for Solana program IDs, signatures, and common patterns
• 6 compression presets -- from real-time (FastCompression) to archival (MaxCompression)
• Multiple backends -- Zstandard, DEFLATE, and LZ4 support via feature flags
• 100% lossless -- rigorous roundtrip validation on every operation
• Thread-safe -- safe for concurrent usage across threads
• Trait-based architecture -- composable CompressionStrategy trait for custom implementations

Presets

Installation

Enable the compression backend you need:

# Zstandard (recommended)
blockchain-compression = { version = "0.1", features = ["zstd"] }

# DEFLATE
blockchain-compression = { version = "0.1", features = ["deflate"] }

# LZ4
blockchain-compression = { version = "0.1", features = ["lz4"] }

Building and Testing

# Build
cargo build --features zstd

# Run tests
cargo test --features zstd

# Run examples
cargo run --example basic_usage --features zstd
cargo run --example performance_benchmark --features zstd

# Benchmarks
cargo bench --features zstd

Documentation

• API Reference -- full Rustdoc on docs.rs
• User Guide -- mkdocs-based guides and tutorials
• API Details -- in-repo API documentation
• Examples -- runnable code examples

License

MIT