Struct AllMasks 

pub struct AllMasks {
    pub lt: u64,
    pub gt: u64,
    pub quot: u64,
    pub apos: u64,
}

Delimiter bitmasks for a block of up to 64 bytes.

Produced by compute_all_masks which loads each 16-byte chunk only once, computing all masks in a single pass. Only the four masks actually consumed by the fused tokenizer are computed.

Fields

lt: u64

< positions.

gt: u64

> positions.

quot: u64

" positions.

apos: u64

' positions.

Trait Implementations

impl Clone for AllMasks

fn clone(&self) -> AllMasks

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for AllMasks

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for AllMasks

fn default() -> AllMasks

Returns the “default value” for a type.

impl Copy for AllMasks