Enum llm_base::ElementType

pub enum ElementType {
    Q4_0,
    Q4_1,
    Q4_2,
    Q5_0,
    Q5_1,
    Q8_0,
    Q8_1,
    I32,
    F16,
    F32,
}

The type of a value in ggml.

Variants

Q4_0

Quantized 4-bit (type 0).

Q4_1

Quantized 4-bit (type 1); used by GPTQ.

Q4_2

Quantized 4-bit (type 2).

Q5_0

Quantized 5-bit (type 0).

Q5_1

Quantized 5-bit (type 1).

Q8_0

Quantized 8-bit (type 0).

Q8_1

Quantized 8-bit (type 1).

I32

Integer 32-bit.

F16

Float 16-bit.

F32

Float 32-bit.

Trait Implementations

impl Clone for Type

fn clone(&self) -> Type

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Type

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Default for Type

fn default() -> Type

Returns the “default value” for a type.

impl Display for Type

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl From<ModelKVMemoryType> for Type

fn from(value: ModelKVMemoryType) -> Self

Converts to this type from the input type.

impl PartialEq<Type> for Type

fn eq(&self, other: &Type) -> bool

This method tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

This method tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl TryFrom<u32> for Type

type Error = ()

The type returned in the event of a conversion error.

fn try_from(t: u32) -> Result<Type, <Type as TryFrom<u32>>::Error>

Performs the conversion.

impl Copy for Type

impl Eq for Type

impl StructuralEq for Type

impl StructuralPartialEq for Type