Enum llm_base::LoadProgress

pub enum LoadProgress {
    HyperparametersLoaded,
    ContextSize {
        bytes: usize,
    },
    TensorLoaded {
        current_tensor: usize,
        tensor_count: usize,
    },
    Loaded {
        file_size: u64,
        tensor_count: usize,
    },
}

Each variant represents a step within the process of loading the model. These can be used to report progress to the user.

Variants

HyperparametersLoaded

The hyperparameters have been loaded from the model.

ContextSize

Fields

bytes: usize

The size of the context.

The context has been created.

TensorLoaded

Fields

current_tensor: usize

The current tensor (0-indexed).

tensor_count: usize

The number of total tensors.

A tensor from the current part has been loaded.

Loaded

Fields

file_size: u64

The number of bytes in the part.

tensor_count: usize

The number of tensors in the part.

A model part has finished fully loading.

Trait Implementations

impl Clone for LoadProgress

fn clone(&self) -> LoadProgress

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LoadProgress

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq<LoadProgress> for LoadProgress

fn eq(&self, other: &LoadProgress) -> bool

This method tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

This method tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for LoadProgress

impl StructuralEq for LoadProgress

impl StructuralPartialEq for LoadProgress