Skip to main content

alg_cdc_chunks

Function alg_cdc_chunks 

Source
pub fn alg_cdc_chunks(
    data: &[u8],
    utf32: bool,
    avg_chunk_size: u32,
) -> IsccResult<Vec<&[u8]>>
Expand description

Split data into content-defined chunks.

Uses the gear rolling hash CDC algorithm to find content-dependent boundaries. Returns at least one chunk (empty slice for empty input). When utf32 is true, aligns cut points to 4-byte boundaries.

ยงErrors

Returns IsccError::InvalidInput if avg_chunk_size < 2. The mask calculation requires log2(avg_chunk_size) >= 1.