Struct FtsTokenizerBuilder 

pub struct FtsTokenizerBuilder { /* private fields */ }

Builder for FtsTokenizer.

Implementations

impl FtsTokenizerBuilder

pub fn stopwords(self, s: StopwordSet) -> Self

Use a custom stopword set instead of the built-in list.

pub fn synonyms(self, m: SynonymMap) -> Self

Attach a synonym map for expansion.

pub fn ngram_size(self, n: usize) -> Self

Override the n-gram size used for TokenKind::Unknown tokens.

Default: 3 (trigrams). Set to 0 to disable n-gram generation.

pub fn pos_tagger(self, t: PosTagger) -> Self

Use a custom POS tagger instead of the built-in table.

pub fn ne_tagger(self, t: NeTagger) -> Self

Use a custom NE gazetteer instead of the built-in table.

pub fn romanization(self, m: RomanizationMap) -> Self

Attach a romanization map so RTGS forms are added to FtsToken::synonyms.

When set, each Thai and Named token whose text is found in the map gets its RTGS romanization appended to synonyms, enabling Latin-script queries (e.g. kin) to match Thai-script documents (e.g. กิน) in PostgreSQL FTS.

Disabled by default — call this method to opt in.

pub fn build(self) -> FtsTokenizer

Consume the builder and return a configured FtsTokenizer.

Trait Implementations

impl Default for FtsTokenizerBuilder

fn default() -> FtsTokenizerBuilder

Returns the “default value” for a type.