Struct StopwordSet 

pub struct StopwordSet { /* private fields */ }

A sorted set of stopwords supporting O(log n) lookup.

Construct once per process with StopwordSet::builtin and reuse across segmentation calls.

Implementations

impl StopwordSet

pub fn builtin() -> Self

Load the built-in Thai stopword list (1 029 entries, PyThaiNLP Apache-2.0).

pub fn from_text(data: &str) -> Self

Build a StopwordSet from a newline-separated word list.

Lines beginning with # and blank lines are ignored. BOM characters (\u{FEFF}) are stripped from every line. The resulting set is sorted and deduplicated.

pub fn contains(&self, word: &str) -> bool

Return true if word is in the stopword set.

pub fn len(&self) -> usize

Number of stopwords in this set.

pub fn is_empty(&self) -> bool

Return true if the set is empty.