santh-dedup 0.1.2

High-performance dataset deduplication for ML training data using MinHash + LSH
Documentation