Skip to main content

QT_Q2_K

Constant QT_Q2_K 

Source
pub const QT_Q2_K: i32 = 13;
Expand description

GGUF Q2_K. Appended after the existing Q4_0 code so kernel ABI values do not move. Mixed-expert artifacts use the generic f32-dequant staged kernel until a target-rig-gated dp4a/MMQ implementation exists.