Struct Qi21PrefillArgs 

pub struct Qi21PrefillArgs<'a> {

    pub model: &'a Arc<CmfModel>,
    pub geom: Qi21Geom,
    pub blocks: &'a [Qi21BlockRef<'a>],
    pub img_in: &'a [f32],
    pub proj_out: &'a [f32],
    pub key: u64,
    pub x: &'a [f32],
    pub lp: usize,
    pub rope_p: (&'a [f32], &'a [f32]),
    pub rope_t: (&'a [f32], &'a [f32]),
    pub vis: &'a [u32],
    pub mods0: &'a [f32],
    pub n: usize,
}

Everything the device needs to build a program and run its prefix.

Fields

model: &'a Arc<CmfModel>

geom: Qi21Geom

blocks: &'a [Qi21BlockRef<'a>]

img_in: &'a [f32]

img_in [hidden, 64] and proj_out [64, hidden], f32.

proj_out: &'a [f32]

key: u64

x: &'a [f32]

Prefix rows after txt_in / img_in, [lp, hidden].

lp: usize

rope_p: (&'a [f32], &'a [f32])

RoPE cos/sin of the prefix rows and of the target rows, [rows, 64].

rope_t: (&'a [f32], &'a [f32])

vis: &'a [u32]

Keys each prefix row sees (a leading run; non-decreasing).

mods0: &'a [f32]

The t = 0 modulation [s1|g1|s2|g2].

n: usize

Target rows.