Skip to main content

dequantize_q4_k_gpu

combs_models

Function dequantize_q4_k_gpu 

Source 
pub fn dequantize_q4_k_gpu<R: Runtime>(
    client: &ComputeClient<R>,
    data: &[u8],
) -> Result<Vec<f32>>
Expand description

Runs the Q4_K dequant-only kernel (validation/debugging path).