Skip to main content

GLM5_EP_GROUPED_PRIME_DISPATCHES

memra_engine::glm5_tp

Static GLM5_EP_GROUPED_PRIME_DISPATCHES 

Source 
pub static GLM5_EP_GROUPED_PRIME_DISPATCHES: AtomicU64
Expand description

Layer-calls that took the per-rank grouped-GEMM EP prime (MEMRA_GLM5_EP_GROUPED_PRIME). Stays 0 whenever the plain grouped-prefill conjuncts do not hold (e.g. non-f16g-eligible expert qtypes — the rig fixture’s Q8_0 bank always falls closed to the sequential walk).