Skip to main content

step_tp_decode_v2_enabled

Function step_tp_decode_v2_enabled 

Source
pub fn step_tp_decode_v2_enabled() -> Result<bool, String>
Expand description

The v2 rank-local Step decode-attention driver: persistent workspaces, evented cross-stream ordering, and a root-device O reduction — same kernels, values, and canonical reduction order as the v1 driver (it requires the F32 mirror so no per-call weight expansion exists on either side of the comparison).