Enum GgmlType 

#[non_exhaustive]
pub enum GgmlType {
    F32 = 0,
    F16 = 1,
    Q4_0 = 2,
    Q4_1 = 3,
    Q5_0 = 6,
    Q5_1 = 7,
    Q8_0 = 8,
    Q8_1 = 9,
    Q2K = 10,
    Q3K = 11,
    Q4K = 12,
    Q5K = 13,
    Q6K = 14,
    Q8K = 15,
    IQ2XXS = 16,
    IQ2XS = 17,
    IQ3XXS = 18,
    IQ1S = 19,
    IQ4NL = 20,
    IQ3S = 21,
    IQ2S = 22,
    IQ4XS = 23,
    I8 = 24,
    I16 = 25,
    I32 = 26,
    I64 = 27,
    F64 = 28,
    IQ1M = 29,
    BF16 = 30,
    TQ1_0 = 34,
    TQ2_0 = 35,
    MXFP4 = 39,
    NVFP4 = 40,
}

GGML tensor storage type (maps to ggml_type).

Used to set QuantizeParams::output_tensor_type and QuantizeParams::token_embedding_type, and for per-tensor type overrides in TensorTypeOverride.

Variants (Non-exhaustive)

Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.

F32 = 0

F16 = 1

Q4_0 = 2

Q4_1 = 3

Q5_0 = 6

Q5_1 = 7

Q8_0 = 8

Q8_1 = 9

Q2K = 10

Q3K = 11

Q4K = 12

Q5K = 13

Q6K = 14

Q8K = 15

IQ2XXS = 16

IQ2XS = 17

IQ3XXS = 18

IQ1S = 19

IQ4NL = 20

IQ3S = 21

IQ2S = 22

IQ4XS = 23

I8 = 24

I16 = 25

I32 = 26

I64 = 27

F64 = 28

IQ1M = 29

BF16 = 30

TQ1_0 = 34

TQ2_0 = 35

MXFP4 = 39

NVFP4 = 40

Trait Implementations

impl Clone for GgmlType

fn clone(&self) -> GgmlType

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for GgmlType

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl From<GgmlType> for ggml_type

fn from(t: GgmlType) -> Self

Converts to this type from the input type.

impl Hash for GgmlType

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for GgmlType

fn eq(&self, other: &GgmlType) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl TryFrom<u32> for GgmlType

type Error = u32

The type returned in the event of a conversion error.

fn try_from(v: ggml_type) -> Result<Self, Self::Error>

Performs the conversion.

impl Copy for GgmlType

impl Eq for GgmlType

impl StructuralPartialEq for GgmlType