pith-text 0.1.0

Text fingerprints: NFC canonicalisation, word 3-shingles and a 128-word MinHash signature
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16

# Text files are stored and checked out with LF on every platform. This is
# not a style preference: the conformance corpus and the reference vectors
# are byte contracts (include_str!/include_bytes! embed the working-tree
# bytes), so a CRLF checkout would silently change their SHA-256.
* text=auto eol=lf

# Text fixtures whose bytes are part of the crate contract (include_str!).
*.txt text eol=lf

# punct_tags.txt carries CRLF sequences as corpus CONTENT (it exists to
# stress whitespace handling), so the text clean filter would rewrite the
# bytes it must preserve. Store it verbatim: no eol conversion either way.
tests/fixtures/punct_tags.txt -text

# The lockfile is generated by cargo and is LF by construction.
Cargo.lock text eol=lf