#[non_exhaustive]pub enum DType {
Show 15 variants
F32,
F64,
F16,
Bf16,
I8,
I16,
I32,
I64,
U8,
U16,
U32,
U64,
F8E4m3,
F8E5m2,
F4E2m1,
}Expand description
Compact discriminant for AccelDtype::KIND.
Variants (Non-exhaustive)§
This enum is marked as non-exhaustive
Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.
F32
F64
F16
Bf16
I8
I16
I32
I64
U8
U16
U32
U64
F8E4m3
8-bit float, E4M3 (sign 1, exp 4, mant 3). Hopper+ fp8 GEMM, FlashAttention v3.
F8E5m2
8-bit float, E5M2 (sign 1, exp 5, mant 2).
F4E2m1
4-bit float, E2M1. Blackwell fp4 inference.
Implementations§
Trait Implementations§
impl Copy for DType
impl Eq for DType
impl StructuralPartialEq for DType
Auto Trait Implementations§
impl Freeze for DType
impl RefUnwindSafe for DType
impl Send for DType
impl Sync for DType
impl Unpin for DType
impl UnsafeUnpin for DType
impl UnwindSafe for DType
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more