Struct TokenSelectionMask 

pub struct TokenSelectionMask {
    pub fingerprint: u64,
    pub valid_token_mask: Arc<[i8]>,
}

Token-validity mask for model-side greedy argmax.

valid_token_mask[id] != 0 means token id may be selected. Tokens at or above valid_token_mask.len() are invalid. The fingerprint lets model backends cache an uploaded device mask without comparing the full vector on every decode step.

Fields

fingerprint: u64

valid_token_mask: Arc<[i8]>

Implementations

impl TokenSelectionMask

pub fn new(valid_token_mask: Vec<i8>) -> Self

pub fn set_tokens_validity(&mut self, token_ids: &[u32], valid: bool) -> bool

Change a small set of token-validity slots and refresh the cache key once. Arc::make_mut keeps the common unshared request mask in place and preserves safety when an in-flight backend policy still owns a clone.

pub fn len(&self) -> usize

pub fn is_empty(&self) -> bool

Trait Implementations

impl Clone for TokenSelectionMask

fn clone(&self) -> TokenSelectionMask

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for TokenSelectionMask

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.