This crate implements the "FastCDC" content defined chunking algorithm in pure Rust. A critical aspect of its behavior is that it returns exactly the same results for the same input. To learn more about content defined chunking and its applications, see "FastCDC: a Fast and Efficient Content-Defined Chunking Approach for Data Deduplication" (paper and presentation)
FastCDC struct for basic usage and an example.
For a slightly more involved example, see the
examples directory in the
Represents a chunk, returned from the FastCDC iterator.
The FastCDC chunker implementation. Use
Largest acceptable value for the average chunk size.
Smallest acceptable value for the average chunk size.
Largest acceptable value for the maximum chunk size.
Smallest acceptable value for the maximum chunk size.
Largest acceptable value for the minimum chunk size.
Smallest acceptable value for the minimum chunk size.