pub enum QuantizationMethod {
NF4,
FP4,
Int4Asymmetric,
Int8BlockWise,
MixedPrecision {
primary_bits: u8,
outlier_bits: u8,
},
}Expand description
Advanced quantization methods
Variants§
NF4
Normalized Float 4-bit with information-theoretic optimal quantiles
FP4
Standard 4-bit floating point
Int4Asymmetric
4-bit integer with asymmetric scaling
Int8BlockWise
8-bit integer with block-wise scaling
MixedPrecision
Mixed precision with dynamic bit allocation
Trait Implementations§
Source§impl Clone for QuantizationMethod
impl Clone for QuantizationMethod
Source§impl Debug for QuantizationMethod
impl Debug for QuantizationMethod
Source§impl PartialEq for QuantizationMethod
impl PartialEq for QuantizationMethod
impl StructuralPartialEq for QuantizationMethod
Auto Trait Implementations§
impl Freeze for QuantizationMethod
impl RefUnwindSafe for QuantizationMethod
impl Send for QuantizationMethod
impl Sync for QuantizationMethod
impl Unpin for QuantizationMethod
impl UnsafeUnpin for QuantizationMethod
impl UnwindSafe for QuantizationMethod
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more