Expand description
This crate implements the “FastCDC” content defined chunking algorithm in pure Rust. A critical aspect of its behavior is that it returns exactly the same results for the same input. To learn more about content defined chunking and its applications, see “FastCDC: a Fast and Efficient Content-Defined Chunking Approach for Data Deduplication” (paper and presentation)
See the FastCDC
struct for basic usage and an example.
For a slightly more involved example, see the examples
directory in the
source repository.
Structs
Represents a chunk, returned from the FastCDC iterator.
The FastCDC chunker implementation. Use
new
to construct a new instance,
and then iterate over the Chunk
s via the Iterator
trait.Constants
Largest acceptable value for the average chunk size.
Smallest acceptable value for the average chunk size.
Largest acceptable value for the maximum chunk size.
Smallest acceptable value for the maximum chunk size.
Largest acceptable value for the minimum chunk size.
Smallest acceptable value for the minimum chunk size.