Skip to main content

Module positional

singe_kernel::cpu

Module positional 

Source
Expand description

RoPE and positional embedding variants.

Structs§

BnsdQkRopeConfig
InterleavedComplexRopeConfig
Interleaved complex-frequency RoPE config for Q/K tensors.
MultiaxisRopeConfig
Three-axis half-split RoPE config for Q/K tensors.

Functions§

interleaved_complex_rope_qk
Applies interleaved complex-frequency RoPE to query and key tensors.
multiaxis_rope_qk
Applies three-axis half-split RoPE to query and key tensors.
rotate_bnsd_qk_rope_reference