Enum DType 

pub enum DType {
    F32,
    F16,
    BF16,
    F64,
    I8,
    I16,
    I32,
    I64,
    U8,
    Q4_0,
    Q4_1,
    Q5_0,
    Q5_1,
    Q8_0,
    Q8_1,
    Q2K,
    Q3K,
    Q4K,
    Q5K,
    Q6K,
    Q8K,
    IQ2XXS,
    IQ2XS,
    IQ2S,
    IQ3XXS,
    IQ3S,
    IQ4XS,
    IQ4NL,
    IQ1S,
    IQ1M,
    TQ1_0,
    TQ2_0,
}

Data type for tensor elements

Variants

F32

F16

BF16

F64

I8

I16

I32

I64

U8

Q4_0

Q4_1

Q5_0

Q5_1

Q8_0

Q8_1

Q2K

Q3K

Q4K

Q5K

Q6K

Q8K

IQ2XXS

IQ2XS

IQ2S

IQ3XXS

IQ3S

IQ4XS

IQ4NL

IQ1S

IQ1M

TQ1_0

TQ2_0

Implementations

impl DType

pub const fn block_size(&self) -> usize

Block size for this type (number of elements per block)

pub const fn block_bytes(&self) -> usize

Bytes per block for this type

pub const fn is_quantized(&self) -> bool

Returns true if this is a quantized type

pub const fn name(&self) -> &'static str

Returns a human-readable name for the dtype

pub const fn size_for_elements(&self, n_elements: usize) -> usize

Calculate the byte size needed for a given number of elements

Trait Implementations

impl Clone for DType

fn clone(&self) -> DType

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for DType

impl Debug for DType

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for DType

impl From<GgmlType> for DType

fn from(ggml_type: GgmlType) -> Self

Converts to this type from the input type.

impl PartialEq for DType

fn eq(&self, other: &DType) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for DType