Skip to main content

dequantize_q8_0_gpu

combs_models

Function dequantize_q8_0_gpu 

Source 
pub fn dequantize_q8_0_gpu<R: Runtime>(
    client: &ComputeClient<R>,
    data: &[u8],
) -> Result<Vec<f32>>
Expand description

Runs the Q8_0 dequant-only kernel (validation/debugging path).