Struct DoubleArrayTrie 

pub struct DoubleArrayTrie { /* private fields */ }

Double-array trie backed by a pre-built i32 array.

Implementations

impl DoubleArrayTrie

pub fn new(array: Vec<i32>, size: usize) -> Self

Create from a pre-built array.

pub fn from_bytes(data: &[u8], offset: usize) -> (Self, usize)

Read a trie from raw bytes at the given offset.

pub fn common_prefix_search( &self, key: &[u8], offset: usize, limit: usize, ) -> Vec<TrieMatch>

Common prefix search: find all keys that are prefixes of the input. This is the core operation for lattice-based tokenization.

pub fn exact_match_search( &self, key: &[u8], offset: usize, length: usize, ) -> i32

Exact match search: look up a single key.

pub fn total_size(&self) -> usize

Total number of units in the trie.