Enum Dtype 

pub enum Dtype {
    F32,
    F16,
    U32,
    I32,
    I8,
}

Variants

F32

32-bit IEEE float. Default activation / weight dtype on the CPU path; fallback for backends without F16 hw support.

F16

16-bit IEEE half. Hot-path dtype on CUDA + Metal (decode q, K/V, GEMM outputs).

U32

32-bit unsigned integer. Block tables, context lens, sorted token ids, args buffers — anything previously tunneled through an FP buffer via alloc_u32 / write_u32.

I32

32-bit signed integer. Expert ids, position offsets, cu_seqlens_q, tpe (tokens-per-expert). Same byte width as U32; separate variant so kernel signatures (device const int* vs device const uint*) can stay type-honest at runtime.

I8

8-bit signed integer. INT8 quantized KV cache cells. Used by KvCacheQuant<B, KvInt8>’s paged stores.

Implementations

impl Dtype

pub const fn bytes_per_elem(self) -> usize

pub const fn name(self) -> &'static str

Human-readable tag for log lines / panic messages.

Trait Implementations

impl Clone for Dtype

fn clone(&self) -> Dtype

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Dtype

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Hash for Dtype

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for Dtype

fn eq(&self, other: &Dtype) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for Dtype

impl Eq for Dtype

impl StructuralPartialEq for Dtype