Internally, the term dictionary relies on the
fst crate to store
a sorted mapping that associate each term to its rank in the lexicographical order.
For instance, in a dictionary containing the sorted terms "abba", "bjork", "blur" and "donovan",
TermOrdinal are respectively
u64-terms, tantivy explicitely uses a
BigEndian representation to ensure that the
lexicographical order matches the natural order of integers.
i64-terms are transformed to
u64 using a continuous mapping
val ⟶ val - i64::min_value()
and then treated as a
f64-terms are transformed to
u64 using a mapping that preserve order, and are then treated
A second datastructure makes it possible to access a
The term dictionary contains all of the terms in
Builder for the new term dictionary.
Given a list of sorted term streams, returns an iterator over sorted unique terms.
Position of the term in the sorted list of terms.