Skip to main content

tmp_buffer_bytes

Function tmp_buffer_bytes 

Source
pub fn tmp_buffer_bytes(num_heads: u32, head_dim: u32) -> usize
Expand description

Compute the size in bytes of the temporary buffer needed for TQ SDPA.

Same formula as F16 SDPA: stores NWG partial output vectors + S/M values.