Module worker 

Structs

AnalysisWorker

A reusable tokenization session over a Tokenizer’s full analysis chain (character filters → segmentation → token filters), owning every per-call buffer: the Viterbi lattice and backtrace scratch (via SegmentWorker), the normalized-text buffer the character filters operate on, and the offset-mapping scratch.