pub enum QuantizationType {
Int8,
Fp16,
Mixed,
Dynamic,
}Expand description
Supported quantization types
Variants§
Int8
8-bit integer quantization (INT8)
Fp16
16-bit floating point (FP16/half precision)
Mixed
Mixed precision (critical layers in FP16, others in INT8)
Dynamic
Dynamic quantization (weights quantized, activations in FP32)
Trait Implementations§
Source§impl Clone for QuantizationType
impl Clone for QuantizationType
impl Copy for QuantizationType
Source§impl Debug for QuantizationType
impl Debug for QuantizationType
Source§impl<'de> Deserialize<'de> for QuantizationType
impl<'de> Deserialize<'de> for QuantizationType
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
impl Eq for QuantizationType
Source§impl PartialEq for QuantizationType
impl PartialEq for QuantizationType
Source§impl Serialize for QuantizationType
impl Serialize for QuantizationType
impl StructuralPartialEq for QuantizationType
Auto Trait Implementations§
impl Freeze for QuantizationType
impl RefUnwindSafe for QuantizationType
impl Send for QuantizationType
impl Sync for QuantizationType
impl Unpin for QuantizationType
impl UnsafeUnpin for QuantizationType
impl UnwindSafe for QuantizationType
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more