Struct GlobalLocalMask 

pub struct GlobalLocalMask {
    pub batch_size: usize,
    pub num_global_tokens: usize,
    pub local_window: usize,
}

Global + Local attention mask

Combines global tokens (attend to all) with local windows (Longformer-style).

Fields

batch_size: usize

Batch size

num_global_tokens: usize

Number of global tokens at the start

local_window: usize

Window size for local attention

Implementations

impl GlobalLocalMask

pub fn new( batch_size: usize, num_global_tokens: usize, local_window: usize, ) -> Self

Create a new global+local attention mask

Trait Implementations

impl AttentionMask for GlobalLocalMask

fn build_mask(&self, graph: &mut EinsumGraph, seq_len: usize) -> Result<usize>

Build a mask tensor in the einsum graph

fn mask_type(&self) -> &str

Get mask type name for documentation

impl Clone for GlobalLocalMask

fn clone(&self) -> GlobalLocalMask

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for GlobalLocalMask

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.