Skip to main content

Crate lzip_parallel

Crate lzip_parallel 

Source
Expand description

lzip — Pure Rust parallel ZIP decompressor.

Architecture: Parse the ZIP Central Directory (at file tail) → Vec. Dispatch every file entry to a rayon worker that DEFLATE-decodes it independently. Results reassembled in Central Directory order.

In-memory slice (< 10 MB): all entries decoded in one parallel pass. Streaming (Read + Seek): Central Directory parsed by seeking to tail; entries read and decoded in parallel batches of 64 — the file is never fully loaded into RAM.

Re-exports§

pub use entry::ZipEntry;
pub use entry::ZipError;
pub use reader::StreamingZipRead;

Modules§

batch
Batch parallel ZIP extraction pipeline.
central_dir
ZIP Central Directory parser.
chunk
Chunk-level parallel DEFLATE decoder.
deflate_scan
DEFLATE full-flush boundary scanner.
entry
ZIP entry decompressor.
parallel
Parallel ZIP decompression for small files (< SMALL_FILE_THRESHOLD).
reader
Streaming parallel ZIP decompressor for large files.

Functions§

decompress_zip
Decompress all file entries in a ZIP byte slice.
decompress_zip_filter
Decompress only entries whose name contains needle.
decompress_zip_filter_set
Decompress only entries whose name exactly matches one of names.
decompress_zip_filter_suffixes
Decompress only entries whose name ends with one of the given suffixes.
decompress_zip_stream
Decompress all file entries from any Read + Seek source without loading the full file into memory.
thread_pool
Get (or create) lzip’s dedicated rayon thread pool.