Skip to main contentModule types
Source - BeamState
- Live decoding state for a single batch of beam searches.
- DenseMask
- Bit-packed dense mask for the first
depth trie layers. - StaticIndex
- Combined STATIC index: dense mask for the first
d layers,
sparse CSR matrix for all deeper layers. - TransitionMatrix
- Stacked CSR transition matrix: interleaves [col_idx, next_state] for
coalesced reads. Row i corresponds to trie node i; values are
(token_id, next_node_id) pairs.
- VntkOutput
- Output of a single VNTK call for one decoding step.