Struct GdnCfg 

pub struct GdnCfg {
    pub num_v_heads: usize,
    pub num_k_heads: usize,
    pub key_head_dim: usize,
    pub value_head_dim: usize,
    pub conv_kernel: usize,
    pub hidden_size: usize,
    pub rms_eps: f64,
    pub output_gate_sigmoid: bool,
}

Fields

num_v_heads: usize

num_k_heads: usize

key_head_dim: usize

value_head_dim: usize

conv_kernel: usize

hidden_size: usize

rms_eps: f64

output_gate_sigmoid: bool

Qwen4-exp trains the output gate as sigmoid(z); older GDN families use SiLU(z). This is part of the operator, not a sampling option.

Implementations

impl GdnCfg

pub fn conv_dim(&self) -> usize

pub fn state_len(&self) -> usize

Packed state: [conv ring (kk−1)·c_dim | S nv·dk·dv], one Vec so the speculative scratch-swap moves ring and condensate together.

Trait Implementations

impl Clone for GdnCfg

fn clone(&self) -> GdnCfg

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for GdnCfg