Enum llm_base::QuantizeProgress

pub enum QuantizeProgress<'a> {
    HyperparametersLoaded,
    TensorLoading {
        name: &'a str,
        dims: [usize; 2],
        element_type: Type,
        n_elements: usize,
    },
    TensorQuantizing {
        name: &'a str,
    },
    TensorQuantized {
        name: &'a str,
        original_size: usize,
        reduced_size: usize,
        history: Vec<f32>,
    },
    TensorSkipped {
        name: &'a str,
        size: usize,
    },
    Finished {
        original_size: usize,
        reduced_size: usize,
        history: Vec<f32>,
    },
}

Progress of quantization.

Variants

HyperparametersLoaded

Hyperparameters have been loaded.

TensorLoading

Fields

name: &'a str

Name of the tensor.

dims: [usize; 2]

Size of the tensor.

element_type: Type

Type of the tensor.

n_elements: usize

Number of elements in the tensor.

A tensor is being loaded.

TensorQuantizing

Fields

name: &'a str

Name of the tensor.

A tensor is being quantized.

TensorQuantized

Fields

name: &'a str

Name of the tensor.

original_size: usize

The original size of the tensor.

reduced_size: usize

The reduced size of the tensor.

history: Vec<f32>

The history of the quantization.

A tensor has been quantized.

TensorSkipped

Fields

name: &'a str

Name of the tensor.

size: usize

The original size (in bytes) of the tensor data.

A tensor has been skipped.

Finished

Fields

original_size: usize

The original size (in bytes) of the model.

reduced_size: usize

The reduced size (in bytes) of the model.

history: Vec<f32>

The history of the quantization.

A model has been quantized.

Trait Implementations

impl<'a> Clone for QuantizeProgress<'a>

fn clone(&self) -> QuantizeProgress<'a>

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl<'a> Debug for QuantizeProgress<'a>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.