pub enum QScheme {
PerTensorAffine,
PerChannelAffine,
PerTensorSymmetric,
PerChannelSymmetric,
Int4PerTensor,
Int4PerChannel,
MixedPrecision,
Binary,
Ternary,
GroupWise,
}Expand description
Quantization scheme
Variants§
PerTensorAffine
Per-tensor affine quantization
PerChannelAffine
Per-channel affine quantization
PerTensorSymmetric
Symmetric quantization
PerChannelSymmetric
Per-channel symmetric
Int4PerTensor
INT4 quantization (4-bit)
Int4PerChannel
INT4 per-channel quantization
MixedPrecision
Mixed precision quantization
Binary
Binary quantization (1-bit)
Ternary
Ternary quantization (2-bit with -1, 0, 1)
GroupWise
Group-wise quantization (groups channels and quantizes per-group)
Trait Implementations§
Source§impl<'de> Deserialize<'de> for QScheme
impl<'de> Deserialize<'de> for QScheme
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Copy for QScheme
impl Eq for QScheme
impl StructuralPartialEq for QScheme
Auto Trait Implementations§
impl Freeze for QScheme
impl RefUnwindSafe for QScheme
impl Send for QScheme
impl Sync for QScheme
impl Unpin for QScheme
impl UnsafeUnpin for QScheme
impl UnwindSafe for QScheme
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more