Skip to main content

plan_quantization

Function plan_quantization 

Source
pub fn plan_quantization(
    model: &CatalogModel,
    explicit: Option<&Quantization>,
    backend: &str,
    hardware: &Hardware,
    options: PlanOptions,
) -> Result<QuantPlan, BackendError>
Expand description

Picks the quantization to pull and enforces fit, bypass and disk preflight before any side effect.