Skip to main content

Module fts

Module fts 

Source
Expand description

Full-text indexing and retrieval. Full-text indexing and retrieval.

The lexical half of the engine. Task 12 builds the versioned analysis pipeline whose identity is index metadata; tasks 13 through 15 build the postings, the scorer, dynamic pruning, and the precision surface on top of it.

Modules§

bm25
The BM25 scorer and corpus statistics. The BM25 scorer.
dict
The sorted, front-coded term dictionary. The sorted, front-coded term dictionary.
fuzzy
Bounded fuzzy matching. Bounded fuzzy matching by dictionary-guided Levenshtein pruning.
index
The lexical index across segments. The lexical index: per-segment postings and store-wide statistics.
norms
Byte-quantized document length norms. Byte-quantized document length norms.
phonetic
Double Metaphone phonetic encoding. Double Metaphone encoding for the opt-in phonetic side-field.
phrase
Phrase matching over stored positions. Phrase matching over the positions task 13 stored.
postings
Persisted posting blocks with positions. The persisted posting format: bit-packed FOR blocks with positions.
prefix
Prefix queries over the sorted dictionary. Prefix queries as a sorted-dictionary range scan.
prune
Dynamic pruning: block-max MAXSCORE and WAND. Dynamic pruning: block-max MAXSCORE and WAND, counter-gated.
query
Structured query descriptions and deterministic expansion provenance. Structured lexical queries and their deterministic expansion plan.
sealed
The sealed segment: the persisted posting format on the query path. The sealed lexical segment: the persisted format, on the query path.
search
The exhaustive-OR scorer and task 14 oracle. The exhaustive-OR scorer: task 13’s deliverable and task 14’s oracle.
snippet
Snippets and match offsets. Snippets and match offsets: how a hit explains itself.
tokenizer
The versioned analysis pipeline and its epoch identity.