pub fn quantize(
input: &Path,
output: &Path,
params: &LlamaQuantizeParams,
) -> Result<(), QuantizeError>Expand description
Quantize the GGUF model at input, writing the result to output.
Wraps llama_model_quantize(fname_inp, fname_out, *const params); a non-zero
return code becomes QuantizeError::Quantize.
ยงErrors
QuantizeError::InvalidPathif a path is not valid UTF-8.QuantizeError::Nulif a path contains an interior NUL byte.QuantizeError::Quantizeif the underlying C call reports failure.