Expand description
Per-chunk compression with an adaptive “is this worth it?” gate.
Every chunk is compressed independently. That costs a little ratio versus a single solid stream, and buys three things this engine needs: chunks can be processed on any worker in any order, a resumed transfer can skip individual chunks, and one corrupt chunk cannot poison the ones after it.
Structs§
- Codec
- Reusable codec state for one worker.
- Encoded
- What the encoder decided for one chunk.
- File
Hint - What we know about a chunk before looking at its bytes.
Enums§
- Algorithm
- Compression algorithm for a chunk payload.
Functions§
- compress_
into - Compress using the calling thread’s
Codec. - decompress_
into - Decompress using the calling thread’s
Codec. - is_
incompressible_ extension - Does this extension name a format that is already entropy-coded?
- with_
codec - Run
fwith the calling thread’s codec.