Skip to main content

tmp_buffer_bytes_with_qL

Function tmp_buffer_bytes_with_qL 

Source
pub fn tmp_buffer_bytes_with_qL(
    num_heads: u32,
    head_dim: u32,
    q_seq_len: u32,
) -> usize
Expand description

ADR-034 task #89 (2026-05-21) — qL-aware temp buffer size. Callers that dispatch with q_seq_len > 1 (spec-decode verify) must use this to size the tmp buffer correctly. tmp_buffer_bytes(...) is kept as the qL=1 wrapper for backward compatibility.