Enum llm_base::LoadError

pub enum LoadError {
    OpenFileFailed {
        source: Error,
        path: PathBuf,
    },
    NoParentPath {
        path: PathBuf,
    },
    ReadExactFailed {
        source: Error,
        bytes: usize,
    },
    Io(Error),
    InvalidUtf8(FromUtf8Error),
    InvalidIntegerConversion(TryFromIntError),
    UnsupportedFileType(i32),
    InvalidMagic {
        path: PathBuf,
        magic: u32,
    },
    InvalidFormatVersion {
        container_type: ContainerType,
        version: u32,
    },
    HyperparametersF16Invalid {
        ftype: i32,
    },
    UnknownTensor {
        tensor_name: String,
        path: PathBuf,
    },
    TensorWrongSize {
        tensor_name: String,
        path: PathBuf,
    },
    UnsupportedElementType {
        tensor_name: String,
        ftype: u32,
        path: PathBuf,
    },
    InvariantBroken {
        path: Option<PathBuf>,
        invariant: String,
    },
    ModelNotCreated {
        path: PathBuf,
    },
    MultipartNotSupported {
        paths: Vec<PathBuf>,
    },
}

Errors encountered during the loading process.

Variants

OpenFileFailed

Fields

source: Error

The original error.

path: PathBuf

The path that failed.

A file failed to open.

NoParentPath

Fields

path: PathBuf

The path without a parent.

There is no parent path for a given path.

ReadExactFailed

Fields

source: Error

The original error.

bytes: usize

The number of bytes that were attempted to be read.

Reading exactly bytes from a file failed.

Io(Error)

A non-specific IO error.

InvalidUtf8(FromUtf8Error)

One of the strings encountered was not valid UTF-8.

InvalidIntegerConversion(TryFromIntError)

One of the integers encountered could not be converted to a more appropriate type.

UnsupportedFileType(i32)

The f16_ hyperparameter had an invalid value.

InvalidMagic

Fields

path: PathBuf

The path that failed.

magic: u32

The magic number that was encountered.

An invalid magic number was encountered during the loading process.

InvalidFormatVersion

Fields

container_type: ContainerType

The format that was encountered.

version: u32

The version that was encountered.

The version of the format is not supported by this version of llm.

HyperparametersF16Invalid

Fields

ftype: i32

The format type that was encountered.

The f16 hyperparameter had an invalid value.

UnknownTensor

Fields

tensor_name: String

The name of the tensor.

path: PathBuf

The path that failed.

The tensor tensor_name was encountered during the loading of path, but was not seen during the model prelude.

TensorWrongSize

Fields

tensor_name: String

The name of the tensor.

path: PathBuf

The path that failed.

The tensor tensor_name did not match its expected size.

UnsupportedElementType

Fields

tensor_name: String

The name of the tensor.

ftype: u32

The format type that was encountered.

path: PathBuf

The path that failed.

The tensor tensor_name did not have the expected format type.

InvariantBroken

Fields

path: Option<PathBuf>

The path that failed.

invariant: String

The invariant that was broken.

An invariant was broken.

This error is not relevant unless loader2 is being used.

ModelNotCreated

Fields

path: PathBuf

The path that failed.

The model could not be created.

This implies that there were no tensors in the model to be loaded.

This error is not relevant unless loader2 is being used.

MultipartNotSupported

Fields

paths: Vec<PathBuf>

The paths that were found.

Multiple parts of the model were found.

Multi-part models are not supported. Please convert the model to a single part.

Trait Implementations

impl Debug for LoadError

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for LoadError

fn fmt(&self, __formatter: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Error for LoadError

fn source(&self) -> Option<&(dyn Error + 'static)>

The lower-level source of this error, if any.

fn description(&self) -> &str

👎Deprecated since 1.42.0: use the Display impl or to_string()

fn cause(&self) -> Option<&dyn Error>

👎Deprecated since 1.33.0: replaced by Error::source, which can support downcasting

fn provide<'a>(&'a self, demand: &mut Demand<'a>)

🔬This is a nightly-only experimental API. (error_generic_member_access)

Provides type based access to context intended for error reports.

impl From<Error> for LoadError

fn from(source: Error) -> Self

Converts to this type from the input type.

impl From<FindAllModelFilesError> for LoadError

fn from(value: FindAllModelFilesError) -> Self

Converts to this type from the input type.

impl From<FromUtf8Error> for LoadError

fn from(source: FromUtf8Error) -> Self

Converts to this type from the input type.

impl From<LoadError> for QuantizeError

fn from(source: LoadError) -> Self

Converts to this type from the input type.

impl From<TryFromIntError> for LoadError

fn from(source: TryFromIntError) -> Self

Converts to this type from the input type.

impl<Hp: Hyperparameters, F: FnMut(LoadProgress)> LoadHandler<LoadError> for Loader<Hp, F>

fn container_type( &mut self, container_type: ContainerType ) -> Result<(), LoadError>

Called when the ContainerType is read.

fn vocabulary_token( &mut self, i: usize, token: Vec<u8>, score: f32 ) -> Result<(), LoadError>

Called when a token is read so it can be added to the model’s vocabulary.

fn read_hyperparameters( &mut self, reader: &mut dyn BufRead ) -> Result<PartialHyperparameters, LoadError>

Called when the model’s hyperparameters need to be read.

fn tensor_buffer(&mut self, info: TensorLoadInfo) -> Result<(), LoadError>

Called when a new crate::Tensor is read for the model.