Struct MultiAlgoCompression 

pub struct MultiAlgoCompression {}

Concrete implementation of the compression service for the adaptive pipeline system

This implementation provides high-performance compression and decompression operations with support for multiple algorithms, parallel processing, and comprehensive error handling. The service is designed to be thread-safe and efficient for streaming operations.

Features

• Multi-Algorithm Support: Brotli, Gzip, Zstd, Lz4
• Parallel Processing: Multi-threaded compression using Rayon
• Adaptive Configuration: Algorithm selection based on data characteristics
• Performance Monitoring: Built-in benchmarking and statistics
• Memory Efficiency: Optimized buffer management and streaming

Thread Safety

The service implementation is thread-safe and can be used concurrently across multiple threads. All operations are stateless and do not modify shared state.

Examples

Implementations

impl MultiAlgoCompression

pub fn new() -> Self

Trait Implementations

impl CompressionService for MultiAlgoCompression

fn compress_chunk( &self, chunk: FileChunk, config: &CompressionConfig, context: &mut ProcessingContext, ) -> Result<FileChunk, PipelineError>

Compresses a file chunk using the specified configuration

fn decompress_chunk( &self, chunk: FileChunk, config: &CompressionConfig, context: &mut ProcessingContext, ) -> Result<FileChunk, PipelineError>

Decompresses a file chunk using the specified configuration

fn estimate_compression_ratio( &self, data_sample: &[u8], algorithm: &CompressionAlgorithm, ) -> Result<f64, PipelineError>

Estimates compression ratio for given data

fn get_optimal_config( &self, file_extension: &str, _data_sample: &[u8], performance_priority: CompressionPriority, ) -> Result<CompressionConfig, PipelineError>

Gets optimal compression configuration for file type

fn validate_config( &self, config: &CompressionConfig, ) -> Result<(), PipelineError>

Validates compression configuration

fn supported_algorithms(&self) -> Vec<CompressionAlgorithm>

Gets supported algorithms

fn benchmark_algorithm( &self, algorithm: &CompressionAlgorithm, test_data: &[u8], ) -> Result<CompressionBenchmark, PipelineError>

Benchmarks compression performance

impl Default for MultiAlgoCompression

fn default() -> Self

Returns the “default value” for a type.

impl StageService for MultiAlgoCompression

fn process_chunk( &self, chunk: FileChunk, config: &StageConfiguration, context: &mut ProcessingContext, ) -> Result<FileChunk, PipelineError>

Process a file chunk according to the operation (Forward or Reverse).

fn position(&self) -> StagePosition

Returns the position where this stage can execute in the pipeline.

fn is_reversible(&self) -> bool

Indicates whether this stage supports reverse operations.

fn stage_type(&self) -> StageType

Returns the type classification of this stage.