Skip to main content

FA_VEC_MIN_DEFAULT

memra_engine

Static FA_VEC_MIN_DEFAULT 

Source 
pub static FA_VEC_MIN_DEFAULT: AtomicUsize
Expand description

Per-model crossover default, set at model load BEFORE the first decode (per-model numeric-config adoption law). qwen keeps the measured 96; gemma4 (nkv=8 SWA) measured vec-always fastest: 119.9 (96) / 130.0 (48) / 133.2 (1) tok/s tg128-regime, 2026-07-10.