Trait Dtype

Source

pub trait Dtype:
    Sealed
    + ConstrainedTypeShape
    + GroundedShape
    + for<'a> IntoBindingValue<'a>
    + Default
    + Copy
    + 'static {
    const NAME: &'static str;
    const BLOCK_BYTES: usize;
    const BLOCK_ELEMS: usize;
}

Expand description

Tensor element-type discipline.

A Dtype declares the canonical block layout of one tensor element (continuous types) or one quantization block (block-32 / block-256 quantized types). The trait is sealed per ADR-014; impls are confined to this module and reachable through TensorDtypeRegistry for container-format-realization enumeration per ADR-057.

Per ADR-017’s closure rule, two Dtype impls with identical BLOCK_BYTES content-address identically at the framework level. The Rust-type distinction is the application-level ergonomics surface (e.g., F16 vs BF16 are framework-equivalent 2-byte shapes but Rust-distinct dtypes carrying distinct floating-point interpretations at the container-format layer).

Required Associated Constants§

Source

const NAME: &'static str

Per-dtype name string (uppercase, GGML-convention spelling).

Source

const BLOCK_BYTES: usize

Bytes per block. For continuous element types this is the element byte count; for quantized types this is the block-bytes count (= the GGML block_q*_* sizeof).

Source

const BLOCK_ELEMS: usize

Elements per block. 1 for continuous types; 32 for legacy quantization; 256 for K-series quantization.

Dyn Compatibility§

This trait is not dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Dtype

Trait Dtype Copy item path

Required Associated Constants§

const NAME: &'static str

const BLOCK_BYTES: usize

const BLOCK_ELEMS: usize

Dyn Compatibility§

Implementors§

impl Dtype for BF16

const NAME: &'static str = "BF16"

const BLOCK_BYTES: usize = F16_BYTES

const BLOCK_ELEMS: usize = 1

impl Dtype for BOOL

const NAME: &'static str = "BOOL"

const BLOCK_BYTES: usize = BOOL_BYTES

const BLOCK_ELEMS: usize = 1

impl Dtype for C64

const NAME: &'static str = "C64"

const BLOCK_BYTES: usize = C64_BYTES

const BLOCK_ELEMS: usize = 1

impl Dtype for C128

const NAME: &'static str = "C128"

const BLOCK_BYTES: usize = C128_BYTES

const BLOCK_ELEMS: usize = 1

impl Dtype for F4_E2M1

const NAME: &'static str = "F4_E2M1"

const BLOCK_BYTES: usize = PACKED_NIBBLE_BYTES

const BLOCK_ELEMS: usize = PACKED_NIBBLE_ELEMS

impl Dtype for F8_E4M3

const NAME: &'static str = "F8_E4M3"

const BLOCK_BYTES: usize = F8_BYTES

const BLOCK_ELEMS: usize = 1

impl Dtype for F8_E4M3_FNUZ

const NAME: &'static str = "F8_E4M3_FNUZ"

const BLOCK_BYTES: usize = F8_BYTES

const BLOCK_ELEMS: usize = 1

impl Dtype for F8_E5M2

const NAME: &'static str = "F8_E5M2"

const BLOCK_BYTES: usize = F8_BYTES

const BLOCK_ELEMS: usize = 1

impl Dtype for F8_E5M2_FNUZ

const NAME: &'static str = "F8_E5M2_FNUZ"

const BLOCK_BYTES: usize = F8_BYTES

const BLOCK_ELEMS: usize = 1

impl Dtype for F16

const NAME: &'static str = "F16"

const BLOCK_BYTES: usize = F16_BYTES

const BLOCK_ELEMS: usize = 1

impl Dtype for F32

const NAME: &'static str = "F32"

const BLOCK_BYTES: usize = F32_BYTES

const BLOCK_ELEMS: usize = 1

impl Dtype for F64

const NAME: &'static str = "F64"

const BLOCK_BYTES: usize = F64_BYTES

const BLOCK_ELEMS: usize = 1

impl Dtype for I4

const NAME: &'static str = "I4"

const BLOCK_BYTES: usize = PACKED_NIBBLE_BYTES

const BLOCK_ELEMS: usize = PACKED_NIBBLE_ELEMS

impl Dtype for I8

const NAME: &'static str = "I8"

const BLOCK_BYTES: usize = INT8_BYTES

const BLOCK_ELEMS: usize = 1

impl Dtype for I16

const NAME: &'static str = "I16"

const BLOCK_BYTES: usize = INT16_BYTES

const BLOCK_ELEMS: usize = 1

impl Dtype for I32

const NAME: &'static str = "I32"

const BLOCK_BYTES: usize = INT32_BYTES

const BLOCK_ELEMS: usize = 1

impl Dtype for I64

const NAME: &'static str = "I64"

const BLOCK_BYTES: usize = INT64_BYTES

const BLOCK_ELEMS: usize = 1

impl Dtype for IQ1_M

const NAME: &'static str = "IQ1_M"

const BLOCK_BYTES: usize

const BLOCK_ELEMS: usize = QK_K

Trait Dtype