Skip to main content

gptq_fold_dev

Function gptq_fold_dev 

Source
pub fn gptq_fold_dev(h_id: u64, n: usize, lambda: f64) -> Option<u64>
Expand description

GPTQ fold of the device Hessian h_id on the device: the upper Cholesky factor of (H + λ·mean(diag)·I)⁻¹ stays there under the returned id and the Hessian is freed. None (no wgpu device, it does not fit, it does not factor): the Hessian is left for gram_take.