Skip to main content

Crate kevy_text

Crate kevy_text 

Source
Expand description

kevy-text — dictionary-free full-text core (RFC 2026-07-04, LOCKED): script-aware tokenization (Latin words + CJK bigrams), per-shard inverted segments maintained synchronously with writes, BM25 ranking with shard-local statistics.

Structs§

KevyTokenizer
The default dictionary-free tokenizer.
TextMatch
One ranked hit.
TextSegment
One shard’s inverted segment.
TextStats
Sizing counters (memory formula + IDX.LIST).

Constants§

BM25_B
Length normalization strength.
BM25_K1
Term-frequency saturation.

Traits§

Tokenizer
Pluggable tokenizer (v2.7 ships only tokenize, the default).

Functions§

tokenize
Tokenize per the default rules (see module doc).