Enum SetMixer 

pub enum SetMixer<'a> {
    Conv {
        in_proj: SetW,
        out_proj: SetW,
        taps: &'a [f32],
        kernel: usize,
    },
    Attn {
        wq: SetW,
        wk: SetW,
        wv: SetW,
        wo: SetW,
        q_norm: Option<&'a [f32]>,
        k_norm: Option<&'a [f32]>,
        head_gate: Option<&'a [f32]>,
        inv_freq: &'a [f32],
        rd: usize,
        nkv: usize,
        window: Option<usize>,
    },
}

Variants

Conv

Fields

in_proj: SetW

out_proj: SetW

taps: &'a [f32]

[hidden][kernel], tap kernel-1 on the current position.

kernel: usize

Attn

Fields

wq: SetW

wk: SetW

wv: SetW

wo: SetW

q_norm: Option<&'a [f32]>

k_norm: Option<&'a [f32]>

head_gate: Option<&'a [f32]>

The per-head sigmoid gate’s f32 rows [nh × hidden].

inv_freq: &'a [f32]

rd: usize

nkv: usize

window: Option<usize>

Sliding window (causal); None: d1’s set mask.