Skip to main content

Module cpu

Module cpu 

Source
Expand description

Plain-Rust CPU references โ€” the source of truth every kernel is validated against.

Functionsยง

add
attention
div
gelu
layernorm
matmul_bt
mha_causal
Causal attention with grouped-query attention (hq query heads, hkv kv heads). hkv==hq = plain MHA.
relu
rmsnorm
rope
sigmoid
silu
softmax
sqrt
sub