Skip to main content

Module types

Module types 

Source

Structsยง

BeamState
Live decoding state for a single batch of beam searches.
DenseMask
Bit-packed dense mask for the first depth trie layers.
StaticIndex
Combined STATIC index: dense mask for the first d layers, sparse CSR matrix for all deeper layers.
TransitionMatrix
Stacked CSR transition matrix: interleaves [col_idx, next_state] for coalesced reads. Row i corresponds to trie node i; values are (token_id, next_node_id) pairs.
VntkOutput
Output of a single VNTK call for one decoding step.