Struct FreqMap 

pub struct FreqMap(/* private fields */);

A word→frequency lookup table backed by the Thai National Corpus (TNC).

Frequencies are raw TNC occurrence counts. Words absent from the table return 0, which is a safe default (the DP scorer simply ignores them).

The built-in table is loaded with FreqMap::builtin. Custom tables can be constructed from any tab-separated word\tcount text via FreqMap::from_tsv.

Implementations

impl FreqMap

pub fn from_tsv(data: &str) -> Self

Parse a tab-separated word\tcount text (one entry per line).

pub fn builtin() -> Self

Load the built-in TNC frequency table.

Parses the embedded tnc_freq.txt (106k entries) into a BTreeMap. This is a pay-once startup cost; the returned FreqMap should be reused across segmentation calls (e.g. stored in Tokenizer).

pub fn get(&self, word: &str) -> u32

Look up a word’s frequency; returns 0 if not found.