Skip to main content

Module classical

Module classical 

Source
Available on crate features minhash or simhash or lsh or tlsh only.
Expand description

Classical (non-neural) fingerprinters.

Two traits cover the two modes txtfp produces fingerprints in:

  • Fingerprinter — feed a whole &str and get its full output. Suited to enrolment / batch jobs.
  • StreamingFingerprinter — push byte chunks as they arrive and consolidate at the end. Suited to large-file pipelines and memory-bounded streaming.

Concrete implementations live in feature-gated submodules: minhash (minhash feature), simhash (simhash feature), lsh (lsh feature).

Modules§

lshlsh
Banded LSH index over MinHash signatures.
minhashminhash
MinHash sketcher.
simhashsimhash
SimHash sketcher.
tlshtlsh
TLSH (Trend Micro Locality-Sensitive Hash) fingerprinter.

Enums§

HashFamilyminhash or simhash
Selectable non-cryptographic hash family.

Traits§

Fingerprinter
Offline fingerprinter — consumes a whole document and emits one fingerprint.
StreamingFingerprinter
Streaming fingerprinter — accumulates bytes across calls, emits one fingerprint at end-of-stream.