pub enum QuantizationFormat {
SignedInt {
bits: u8,
},
UnsignedInt {
bits: u8,
},
FloatingPoint {
bits: u8,
},
BlockWise {
block_size: usize,
bits: u8,
},
Custom {
name: String,
bits: u8,
},
}Expand description
Quantization formats supported by hardware
Variants§
SignedInt
Signed integer quantization
UnsignedInt
Unsigned integer quantization
FloatingPoint
Floating-point quantization
BlockWise
Block-wise quantization
Custom
Custom quantization format
Trait Implementations§
Source§impl Clone for QuantizationFormat
impl Clone for QuantizationFormat
Source§fn clone(&self) -> QuantizationFormat
fn clone(&self) -> QuantizationFormat
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for QuantizationFormat
impl Debug for QuantizationFormat
Source§impl<'de> Deserialize<'de> for QuantizationFormat
impl<'de> Deserialize<'de> for QuantizationFormat
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for QuantizationFormat
impl PartialEq for QuantizationFormat
Source§impl Serialize for QuantizationFormat
impl Serialize for QuantizationFormat
impl StructuralPartialEq for QuantizationFormat
Auto Trait Implementations§
impl Freeze for QuantizationFormat
impl RefUnwindSafe for QuantizationFormat
impl Send for QuantizationFormat
impl Sync for QuantizationFormat
impl Unpin for QuantizationFormat
impl UnsafeUnpin for QuantizationFormat
impl UnwindSafe for QuantizationFormat
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> ConfigSerializable for Twhere
T: Serialize + for<'de> Deserialize<'de>,
impl<T> ConfigSerializable for Twhere
T: Serialize + for<'de> Deserialize<'de>,
Source§fn save_to_file(&self, path: &Path) -> Result<(), TrustformersError>
fn save_to_file(&self, path: &Path) -> Result<(), TrustformersError>
Save to file
Source§fn load_from_file(path: &Path) -> Result<Self, TrustformersError>where
Self: Sized,
fn load_from_file(path: &Path) -> Result<Self, TrustformersError>where
Self: Sized,
Load from file
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more