Expand description
Codec orchestrator — compress and decompress through the DataCortex pipeline.
Phase 1: Format preprocessing + zstd (Fast mode).
Phase 3: Full CM engine with higher-order models + mixer + APM (Balanced mode, ~256MB).
Phase 5: Full CM engine with 2x context maps (Max mode, ~512MB).
Phase 6: Dual-path CM + LLM with MetaMixer (Max mode with neural feature).
Phase 7: Dual-path CM + GRU byte-level predictor (Balanced mode).
Functions§
- compress
- Compress
datainto .dcx format, writing tooutput. - compress_
to_ vec - Compress to Vec (convenience).
- compress_
to_ vec_ with_ model - Compress to Vec with explicit model path.
- compress_
to_ vec_ with_ options - Compress to Vec with explicit model path and zstd level override.
- compress_
with_ full_ options - Compress with all options including external dictionary.
- compress_
with_ model - Compress with optional explicit model path (for neural Max mode).
- compress_
with_ options - Compress with optional explicit model path and zstd level override.
- decompress
- Decompress a .dcx file from
input, returning the original data. - decompress_
from_ slice - Decompress from slice (convenience).
- decompress_
with_ model - Decompress with optional explicit model path (for neural Max mode).
- raw_
zstd_ compress - Compress raw data with zstd at a given level (for benchmark comparison).
- read_
header - Read header only (for
infocommand). - train_
dict - Train a zstd dictionary from multiple sample files.