Struct QkvSplitParams 

pub struct QkvSplitParams {
    pub seq: u32,
    pub q_sp: u32,
    pub k_sp: u32,
    pub v_sp: u32,
}

Parameters for a fused-QKV split operation.

Fields

seq: u32

Number of tokens in the sequence dimension.

q_sp: u32

Q span per token, in f32 elements (== n_k_heads * d_k).

k_sp: u32

K span per token, in f32 elements (== n_k_heads * d_k).

v_sp: u32

V span per token, in f32 elements (== n_v_heads * d_v).

Trait Implementations

impl Clone for QkvSplitParams

fn clone(&self) -> QkvSplitParams

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for QkvSplitParams

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Copy for QkvSplitParams