Deduplicate images and videos using perceptual hashing
Dublette scans a directory for visually similar media files and removes the duplicates. Unlike byte-level comparison, it uses perceptual hashing to detect files that look the same even if they differ in format, compression, or metadata.
Features
- Perceptual hashing -- detects visually similar images and videos, not just byte-identical copies
- Image and video support -- handles jpg, png, gif, webp, bmp, tiff, and 9 video formats via ffmpeg
- Dry-run mode -- preview what would be deleted before committing
- JSON output -- machine-readable output for scripting and CI pipelines
- Parallel processing -- hashes files concurrently using all available cores
- Configurable threshold -- tune sensitivity with hamming distance control
Quick Start
Install dublette from a pre-compiled binary or via cargo:
Preview duplicates:
Delete duplicates:
Documentation
Full documentation available at dublette.sripwoud.xyz:
- Installation - Detailed setup guide
- Quick Start - Step-by-step walkthrough
- CLI Reference - All options documented
- How It Works - Perceptual hashing explained
Requirements
- (Optional) ffmpeg for video deduplication