Skip to main content

Q4_0X4_INTERLEAVE

ferrox_quant::repack

Constant Q4_0X4_INTERLEAVE 

Source 
pub const Q4_0X4_INTERLEAVE: usize = 4;
Expand description

qs interleave width for ggml_gemv_q4_0_4x4_q8_0 (NEON SDOT). The DotProd-only default; q4_0x4_interleave picks 8 on i8mm hosts.