Struct FuseSwiGLU 

pub struct FuseSwiGLU;

Detects the post-FuseSharedInputMatMul SwiGLU pattern and replaces it with a single Op::FusedSwiGLU node consuming the concatenated matmul.

Pattern (after FuseSharedInputMatMul has fused fc11+fc12 into one mm): %cat = matmul(%x, concat(%fc11_w, %fc12_w)) ; shape […, 2N] %up = narrow(%cat, axis=-1, 0, N) ; shape […, N] %gate = narrow(%cat, axis=-1, N, N) ; shape […, N] %silu = silu(%gate) %out = mul(%up, %silu)

Becomes: %out = fused_swiglu(%cat)

Saves three kernel launches (two narrows + silu + mul → one kernel) and keeps up/gate resident in registers.

Single-use guard: only fuses when each intermediate (narrow, narrow, silu) has exactly one consumer. The mul may have any number of consumers.

Trait Implementations

impl Pass for FuseSwiGLU

fn name(&self) -> &str

Human-readable name for logging.

fn run(&self, graph: Graph) -> Graph

Transform the graph. Returns a new graph (or the same if no changes).