Struct SegmentDeduplicator 

pub struct SegmentDeduplicator { /* private fields */ }

Performs segment-level deduplication over a corpus of media segments.

Implementations

impl SegmentDeduplicator

pub fn new() -> Self

Create a new deduplicator with default configuration.

pub fn with_config(config: SegmentDedupConfig) -> Self

Create a new deduplicator with explicit configuration.

pub fn add_segment( &mut self, source_id: &str, frame_offset: usize, bytes: &[u8], )

Add a segment identified by source_id starting at frame_offset with the given raw bytes (representing that segment’s content).

pub fn find_duplicates(&self) -> Vec<Vec<&SegmentRecord>>

Find all duplicate segment groups (groups where 2+ sources share a hash).

pub fn unique_count(&self) -> usize

Returns the number of unique segment hashes stored.

pub fn total_count(&self) -> usize

Returns the total number of segment records stored.

pub fn config(&self) -> &SegmentDedupConfig

Returns the underlying config.

Trait Implementations

impl Debug for SegmentDeduplicator

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SegmentDeduplicator

fn default() -> SegmentDeduplicator

Returns the “default value” for a type.