Expand description
kevy-text — dictionary-free full-text core (RFC 2026-07-04, LOCKED): script-aware tokenization (Latin words + CJK bigrams), per-shard inverted segments maintained synchronously with writes, BM25 ranking with shard-local statistics.
Structs§
- Kevy
Tokenizer - The default dictionary-free tokenizer.
- Text
Match - One ranked hit.
- Text
Segment - One shard’s inverted segment.
- Text
Stats - Sizing counters (memory formula + IDX.LIST).
Constants§
Traits§
Functions§
- tokenize
- Tokenize per the default rules (see module doc).