#[non_exhaustive]pub enum QuantMode {
Affine,
Mxfp4,
Mxfp8,
Nvfp4,
}Expand description
A quantization mode (MLX’s mode strings: "affine", "mxfp4", "mxfp8", "nvfp4").
Variants (Non-exhaustive)§
This enum is marked as non-exhaustive
Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.
Affine
bits per value with a scale and a bias per group (MLX’s default).
Mxfp4
E2M1 values in groups of 32 with an E8M0 (power-of-two) scale.
Mxfp8
E4M3 values in groups of 32 with an E8M0 scale.
Nvfp4
E2M1 values in groups of 16 with an E4M3 scale.
Implementations§
Trait Implementations§
impl Copy for QuantMode
impl Eq for QuantMode
Source§impl Static for QuantMode
impl Static for QuantMode
Source§fn hash_static(&self, h: &mut dyn Hasher)
fn hash_static(&self, h: &mut dyn Hasher)
Feeds the value to
h.impl StructuralPartialEq for QuantMode
Auto Trait Implementations§
impl Freeze for QuantMode
impl RefUnwindSafe for QuantMode
impl Send for QuantMode
impl Sync for QuantMode
impl Unpin for QuantMode
impl UnsafeUnpin for QuantMode
impl UnwindSafe for QuantMode
Blanket Implementations§
impl<T> AutoreleaseSafe for Twhere
T: ?Sized,
impl<T> Boilerplate for T
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more