Skip to main content

gated_delta_step

Function gated_delta_step 

Source
pub fn gated_delta_step(p: GatedDeltaStep<'_>) -> Result<Vec<f32>, EngineError>
Expand description

One-token Gated DeltaNet recurrence (Qwen3.5 / Bonsai linear attention).

state is [n_heads * dk * dv] (per-head S[dk, dv]). q/k are [n_heads * dk], v [n_heads * dv], g/beta [n_heads].