Struct NetworkDedupEngine 

pub struct NetworkDedupEngine { /* private fields */ }

Engine for detecting duplicates across distributed media nodes.

Add manifests from each remote node then call [find_cross_node_duplicates] to get a list of CrossNodeGroups.

Implementations

impl NetworkDedupEngine

pub fn new(config: NetworkDedupConfig) -> Self

Create a new engine with the given configuration.

pub fn add_manifest(&mut self, manifest: NodeManifest)

Add a NodeManifest to the engine.

pub fn manifest_count(&self) -> usize

Return the number of manifests registered.

pub fn total_records(&self) -> usize

Return the total number of file records across all manifests.

pub fn find_cross_node_duplicates(&self) -> Vec<CrossNodeGroup>

Find duplicate groups across all registered node manifests.

The algorithm runs two passes:

1. Exact pass – groups records by Blake3 hex digest. Only groups that span at least two different nodes are returned.
2. Perceptual pass – for records with pHash and not already grouped as exact duplicates, applies Hamming-distance comparison with the configured threshold and duration guard.

pub fn cross_node_summary(&self) -> CrossNodeSummary

Return a summary of how many duplicates span how many nodes.

Trait Implementations

impl Debug for NetworkDedupEngine

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for NetworkDedupEngine

fn default() -> Self

Returns the “default value” for a type.