Skip to main content

auto_select_quantization

Function auto_select_quantization 

Source
pub fn auto_select_quantization(
    model: &KnownModel,
    available_ram_gb: u32,
) -> Quantization
Expand description

Auto-select the best quantization for available RAM.

§Example

use nika_core::catalogs::models::{find_model, auto_select_quantization};

let model = find_model("qwen3:8b").unwrap();
let quant = auto_select_quantization(model, 16);
// With 16GB RAM, should select Q4_K_M or better