Module compression 

Storage compression and optimization module

Implements multi-tier compression strategy:

• Hot data (recent): LZ4 for speed
• Warm data (1-30 days): Zstd level 3 for balance
• Cold data (>30 days): Zstd level 19 for maximum compression

Also provides:

• Deduplication for common patterns (system prompts)
• Automatic tiering based on age
• Compression ratio tracking

Structs

CompressionEngine

Compression engine

CompressionStats

Enums

CompressionType

Compression type identifier

StorageTier

Storage tier based on data age

Functions

choose_compression

Helper: Determine optimal compression for payload