Skip to main content

extract_quantization

Function extract_quantization 

Source
pub fn extract_quantization(filename: &str) -> Option<String>
Expand description

Extract quantization type from a filename.

Supports: Q2_K, Q3_K_S, Q3_K_M, Q3_K_L, Q4_K_S, Q4_K_M, Q5_K_S, Q5_K_M, Q6_K, Q8_0, F16, F32

ยงExample

use spn_native::extract_quantization;

assert_eq!(extract_quantization("model-q4_k_m.gguf"), Some("Q4_K_M".to_string()));
assert_eq!(extract_quantization("model-Q8_0.gguf"), Some("Q8_0".to_string()));
assert_eq!(extract_quantization("model.gguf"), None);