Struct GraphDash 

pub struct GraphDash<'a> {

    pub qk_proj: &'a [f32],
    pub q_norm: &'a [f32],
    pub k_norm: &'a [f32],
    pub head_cls: &'a [f32],
    pub idx_scale: f32,
    pub floor: f32,
    pub sigma: f32,
    pub k: usize,
    pub block: usize,
    pub local_blocks: usize,
    pub nblk: usize,
    pub cands: &'a [u32],
    pub coff: &'a [u32],
    pub angles: &'a [f32],
}

One layer’s DASH router for the token graph (gpu_wgpu::uocr).

Fields

qk_proj: &'a [f32]

[2·index_dim, hidden], the q rows then the k rows.

q_norm: &'a [f32]

k_norm: &'a [f32]

head_cls: &'a [f32]

idx_scale: f32

floor: f32

sigma: f32

k: usize

block: usize

local_blocks: usize

nblk: usize

cands: &'a [u32]

Candidate blocks of the rows, coff[row]..coff[row + 1] per row.

coff: &'a [u32]

angles: &'a [f32]

The rows’ rotation angles, [rows][head_dim / 2].

Trait Implementations

impl<'a> Clone for GraphDash<'a>

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'a> Copy for GraphDash<'a>