pub static KV_FP8_FORCE: Atomic<i8>Expand description
Per-model FP8-KV door — lives in memra-kv next to the format policy it drives
(re-export keeps crate::KV_FP8_FORCE setters in model.rs/hybrid.rs working).
Per-model FP8-KV door (-1 = unset → env/default off; 0 = off; 1 = on). Set at qwen
model load: the 2026-07-12 arc closed per-model — 9B +0.7-4% scaling with depth,
27B flat (weight-bound), 35B −2% (fp8 format-gates its v3 dp4a lane off). Explicit
MEMRA_KV_FP8 wins. 9B adoption attempt REVERTED by measurement 2026-07-29 (−1% at 12k
on the then-current build) — loaders currently store 0.