Module silu_backward 

Elementwise SiLU (swish) forward + reverse-mode backward.

Used by hf2q’s ADR-020 Track 1 SwiGLU FFN on GpuTape (iter-11b).

Forward: silu(x) = x · sigmoid(x) Backward: dx[i] = dy[i] · silu'(x[i]) where silu'(x) = sigmoid(x) · (1 + x · (1 − sigmoid(x)))

Note: mlx-native already has silu_mul_f32 (= silu(gate) * up) used by the inference forward. This module adds the standalone silu_f32 + matching backward kernel needed for autograd.

Statics

SILU_BACKWARD_SHADER_SOURCE

Functions

dispatch_silu_backward_f32

Encode dx[i] = dy[i] · silu'(x[i]). x is the FORWARD INPUT.

dispatch_silu_f32

Encode output[i] = silu(input[i]) = input[i] · sigmoid(input[i]).

register