Skip to main content

quantize

Function quantize 

Source
pub fn quantize(
    input: &Path,
    output: &Path,
    params: &LlamaQuantizeParams,
) -> Result<(), QuantizeError>
Expand description

Quantize the GGUF model at input, writing the result to output.

Wraps llama_model_quantize(fname_inp, fname_out, *const params); a non-zero return code becomes QuantizeError::Quantize.

ยงErrors