Struct StorageCompressionPipeline 

pub struct StorageCompressionPipeline {
    pub config: PipelineConfig,
    pub total_compressed: u64,
    pub total_bytes_in: u64,
    pub total_bytes_out: u64,
    pub algo_counters: HashMap<String, u64>,
}

Multi-stage compression pipeline with content-aware algorithm selection.

Example

use ipfrs_storage::compression_pipeline::{
    StorageCompressionPipeline, PipelineConfig, CompressionHint,
};

let mut pipeline = StorageCompressionPipeline::new(PipelineConfig::default());
let data = b"aaaaaabbbbbbcccccccccdddddddddeeeeeeeeeee";
let result = pipeline.compress(data, CompressionHint::Binary);
let recovered = pipeline.decompress(&result.data, &result.algo).unwrap();
assert_eq!(&recovered, data);

Fields

config: PipelineConfig

Pipeline configuration.

total_compressed: u64

Number of successful compress calls.

total_bytes_in: u64

Total raw bytes fed into the pipeline.

total_bytes_out: u64

Total compressed bytes emitted by the pipeline.

algo_counters: HashMap<String, u64>

Per-algorithm usage counters.

Implementations

impl StorageCompressionPipeline

pub fn new(config: PipelineConfig) -> Self

Create a new pipeline with the supplied configuration.

pub fn compress( &mut self, data: &[u8], _hint: CompressionHint, ) -> CompressionResult

Compress data using the first pipeline stage whose conditions are met.

Stages are tried in the order defined in PipelineConfig::stages. A stage is skipped if:

• data.len() < stage.min_input_size, or
• config.enable_ratio_check is true and the resulting ratio exceeds stage.max_ratio.

If no stage accepts the data, the fallback_algo is used.

pub fn decompress( &self, data: &[u8], algo: &CompressionAlgo, ) -> Result<Vec<u8>, CompressionError>

Decompress data using the specified algorithm.

pub fn compress_with_algo(&self, data: &[u8], algo: &CompressionAlgo) -> Vec<u8>

Compress data with a specific algorithm, returning the raw bytes.

pub fn detect_hint(data: &[u8]) -> CompressionHint

Detect content hint from the first few bytes of data.

pub fn auto_compress(&mut self, data: &[u8]) -> CompressionResult

Automatically detect the content hint and then compress.

pub fn pipeline_stats(&self) -> PipelineStats

Return a snapshot of the current pipeline statistics.

Trait Implementations

impl Debug for StorageCompressionPipeline

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.