Module dedup

Module dedup 

Source
Expand description

Content deduplication for storage efficiency.

This module provides chunk-level deduplication using BLAKE3 hashes to identify identical chunks across different content.

Structs§

ChunkRef
Reference to a deduplicated chunk.
ChunkReference
Reference from content to a chunk.
ContentDedupInfo
Content deduplication info.
DedupConfig
Deduplication configuration.
DedupEntry
Deduplication entry for tracking chunk usage.
DedupStats
Deduplication statistics.
DedupStore
Deduplication store for managing deduplicated chunks.
EnhancedChunkRef
Enhanced chunk reference with detailed tracking.
GcResult
Garbage collection result.
IntegrityCheckResult
Result of a reference integrity check.
ReferenceEntry
Reference tracking entry for detailed auditing.
RemovalImpact
Impact analysis for content removal.

Enums§

StoreResult
Result of storing a chunk with deduplication.

Functions§

find_duplicates
Find duplicate chunks between two content items.