Skip to main content

dequantize_q5_k_gpu

combs_models

Function dequantize_q5_k_gpu 

Source 
pub fn dequantize_q5_k_gpu<R: Runtime>(
    client: &ComputeClient<R>,
    data: &[u8],
) -> Result<Vec<f32>>
Expand description

Runs the Q5_K dequant-only kernel (validation/debugging path).