Skip to main content

MXFP4_GROUP_SIZE

Constant MXFP4_GROUP_SIZE 

Source
pub const MXFP4_GROUP_SIZE: usize = 32;
Expand description

Elements per MXFP4 scale group (real, confirmed both from ggml’s QK_MXFP4 and directly from a real Kimi K3 shard’s own tensor shapes: *.weight_scale is in_dim/32 bytes, *.weight_packed is in_dim/2 bytes).