Struct DeltaDeduplicator 

pub struct DeltaDeduplicator { /* private fields */ }

Delta deduplicator using rolling hash and KMP.

Orchestrates the two-phase deduplication approach:

1. Rolling hash for fast filtering
2. KMP for exact verification

Example

let mut dedup = DeltaDeduplicator::new();

// Add accumulated content
dedup.add_accumulated("Hello World");

// Check if a delta is a duplicate
if let Some(new_portion) = dedup.extract_new_content("Hello World!") {
    // "!" is the new portion
    assert_eq!(new_portion, "!");
}

Implementations

impl DeltaDeduplicator

pub fn is_likely_snapshot(delta: &str, accumulated: &str) -> bool

Check if delta is likely a snapshot using rolling hash only.

This is a faster O(n) check that may have false positives due to hash collisions. Use extract_new_content for verified results.

Arguments

• delta - The incoming delta to check
• accumulated - The previously accumulated content

Returns

• true - Delta may be a snapshot (hash matches)
• false - Delta is definitely not a snapshot (hash doesn’t match)

pub fn is_likely_snapshot_with_thresholds( delta: &str, accumulated: &str, ) -> bool

Check if delta is likely a snapshot with strong overlap detection.

This is an enhanced version of is_likely_snapshot that applies strong overlap thresholds to prevent false positives on intentional repetitions.

Strong Overlap Detection

This method only returns true when:

• The overlap meets minimum character count threshold (default: 30 chars)
• The overlap meets minimum ratio threshold (default: 50% of delta)
• The overlap ends at a safe boundary (whitespace/punctuation/newline)
• Short chunks (< 20 chars) are only deduped if exact match

Arguments

• delta - The incoming delta to check
• accumulated - The previously accumulated content

Returns

• true - Delta is a snapshot meeting strong overlap criteria
• false - Delta is either genuine or overlap is too weak

pub fn extract_new_content_with_thresholds<'a>( delta: &'a str, accumulated: &str, ) -> Option<&'a str>

Extract new content from a snapshot with strong overlap detection.

This is an enhanced version of extract_new_content that only extracts new content when the overlap meets strong overlap thresholds.

Arguments

• delta - The incoming delta to check
• accumulated - The previously accumulated content

Returns

• Some(new_portion) - The overlap meets thresholds, returns new portion
• None - The overlap is too weak or not a snapshot

pub fn clear(&mut self)

Clear all tracked content.

Trait Implementations

impl Clone for DeltaDeduplicator

fn clone(&self) -> DeltaDeduplicator

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for DeltaDeduplicator

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for DeltaDeduplicator

fn default() -> DeltaDeduplicator

Returns the “default value” for a type.