preflate-rs

preflate-rs is a port of the C++ preflate library to split deflate streams into uncompressed data and reconstruction information, or reconstruct the original deflate stream from those two.

IMPORTANT: This library is still in initial development, so there are probably breaking changes being done fairly frequently.

The resulting uncompressed content can then be recompressed by a more modern compression technique such as Zstd, lzma, etc. This library is designed to be used as part of a cloud storage system that requires exact binary storage of content, so the libary needs to make sure that the Deflate content is recreated exactly as it was written. This is not trivial, since Default has a large degree of freedom in choosing both how the distance/length pairs are chose and how the Huffman trees are created.

Note that the data formats of the recompression information are different and incompatible to the original preflate implemenation, as this library uses a different arithmetic encoder (shared from the lepton JPEG compression library).

How to Use This Library

Building From Source

Rust 1.65 or Above

git clone https://github.com/microsoft/preflate-rs
cd preflate-rs
cargo build
cargo test
cargo build --release

Running

There is an preflate_util.exe wrapper that is built as part of the project that can be used to test out the library against Deflate compressed content.

Contributing

There are many ways in which you can participate in this project, for example:

Submit bugs and feature requests, and help us verify as they are checked in
Review source code changes or submit your own features as pull requests.
The library uses only stable features.

Code of Conduct

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.

License

Licensed under the Apache 2.0 license.