Skip to main content

FA_SPW_DEFAULT

memra_engine

Static FA_SPW_DEFAULT 

Source 
pub static FA_SPW_DEFAULT: AtomicUsize
Expand description

Per-model windowed-split default (MEMRA_FA_SPW overrides): gemma MoE (26B, nkv=8) measured 32 (grid-limited t=1 under the raw-e4m3 sV ceiling, 2026-07-12); dense gemma (31B) measured 64 (37.13/37.12 vs 36.87/36.86 at 1.7k, N=2 — different attention geometry).