Struct VntkResult 

pub struct VntkResult {
    pub tokens: Vec<u32>,
    pub next_nodes: Vec<u32>,
    pub valid: Vec<bool>,
    pub dense_masks: Vec<bool>,
    pub branch_size: usize,
}

Output of a single VNTK call covering all beams at one decoding step.

Index arithmetic:

• tokens[i * branch_size + j] — j-th token candidate for beam i
• next_nodes[i * branch_size + j] — trie node reached by that token
• valid[i * branch_size + j] — whether slot j is a real child
• dense_masks[i * vocab_size + tok]— O(1) membership test for beam i

Fields

tokens: Vec<u32>

Token IDs: shape [n × branch_size], invalid slots hold 0.

next_nodes: Vec<u32>

Next-node IDs: shape [n × branch_size], invalid slots hold 0.

valid: Vec<bool>

Validity flags: shape [n × branch_size].

dense_masks: Vec<bool>

Dense boolean mask: shape [n × vocab_size].

branch_size: usize

B_t: the padded branch-factor used at this level.

Implementations

impl VntkResult

pub fn children_for(&self, i: usize) -> impl Iterator<Item = (u32, u32)> + '_

Returns the valid (token, next_node) pairs for beam i.

pub fn mask_for(&self, i: usize, vocab_size: usize) -> &[bool]

Returns the dense mask slice for beam i (length = vocab_size).

pub fn global_mask(&self, vocab_size: usize) -> Vec<bool>

Collapses all per-beam dense masks into a single OR-reduced mask of length vocab_size. Used when all beams in a batch share one logit vector (single-query inference).

pub fn packed_mask_for(&self, i: usize, vocab_size: usize) -> Vec<u64>

Converts the dense bool mask for beam i into a packed Vec<u64> (same layout as DenseMask::bits) for cheap bitwise AND with the model’s top-k mask.

Trait Implementations

impl Clone for VntkResult

fn clone(&self) -> VntkResult

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for VntkResult

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.