Struct Config 

pub struct Config {
    pub bits: u8,
    pub per_channel: bool,
    pub excluded_layers: Vec<String>,
    pub min_elements: usize,
    pub models: Vec<ModelConfig>,
    pub batch: Option<BatchConfig>,
}

Top-level quantization configuration.

Can be loaded from a YAML or TOML file with Config::from_file.

Fields

bits: u8

Default bit width (4 or 8). Defaults to 8.

per_channel: bool

Default per-channel setting. Defaults to false.

excluded_layers: Vec<String>

Layer names to exclude from quantization globally.

min_elements: usize

Minimum number of elements a tensor must have to be quantized. Tensors smaller than this are kept in FP32. Defaults to 0 (no minimum).

models: Vec<ModelConfig>

Per-model configuration overrides.

batch: Option<BatchConfig>

Batch processing configuration.

Implementations

impl Config

pub fn from_file(path: impl AsRef<Path>) -> Result<Self>

Load a config from a YAML or TOML file (auto-detected by extension).

Errors

Returns QuantizeError::Config on I/O, parse, or unsupported format errors.

pub fn from_yaml(content: &str) -> Result<Self>

Parse configuration from a YAML string.

pub fn from_toml(content: &str) -> Result<Self>

Parse configuration from a TOML string.

pub fn validate(&self) -> Result<()>

Validate the configuration (bits values, non-empty paths).

Errors

Returns QuantizeError::Config if any field is invalid.

pub fn get_bits(&self, model: &ModelConfig) -> u8

Effective bit width for a model (model override or global default).

pub fn get_per_channel(&self, model: &ModelConfig) -> bool

Effective per-channel setting for a model (model override or global default).

pub fn get_excluded_layers(&self, model: &ModelConfig) -> Vec<String>

Effective excluded-layers list: global list merged with model-level list.

pub fn get_min_elements(&self, model: &ModelConfig) -> usize

Effective min-elements threshold for a model.

pub fn get_layer_bits(&self, model: &ModelConfig) -> HashMap<String, u8>

Effective per-layer bit-width overrides for a model.

Layer names are model-specific so there is no global map to merge; this simply returns the model’s own layer_bits map.

Trait Implementations

impl Clone for Config

fn clone(&self) -> Config

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Config

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for Config

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for Config

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.