pub enum MobileQuantizationScheme {
Int8,
Int4,
FP16,
Dynamic,
}Expand description
Mobile-optimized quantization schemes
Variants§
Int8
8-bit integer quantization
Int4
4-bit integer quantization (ultra-low memory)
FP16
Float16 quantization
Dynamic
Dynamic quantization
Trait Implementations§
Source§impl Clone for MobileQuantizationScheme
impl Clone for MobileQuantizationScheme
Source§fn clone(&self) -> MobileQuantizationScheme
fn clone(&self) -> MobileQuantizationScheme
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for MobileQuantizationScheme
impl Debug for MobileQuantizationScheme
Source§impl<'de> Deserialize<'de> for MobileQuantizationScheme
impl<'de> Deserialize<'de> for MobileQuantizationScheme
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for MobileQuantizationScheme
impl PartialEq for MobileQuantizationScheme
Source§impl Serialize for MobileQuantizationScheme
impl Serialize for MobileQuantizationScheme
impl Copy for MobileQuantizationScheme
impl Eq for MobileQuantizationScheme
impl StructuralPartialEq for MobileQuantizationScheme
Auto Trait Implementations§
impl Freeze for MobileQuantizationScheme
impl RefUnwindSafe for MobileQuantizationScheme
impl Send for MobileQuantizationScheme
impl Sync for MobileQuantizationScheme
impl Unpin for MobileQuantizationScheme
impl UnsafeUnpin for MobileQuantizationScheme
impl UnwindSafe for MobileQuantizationScheme
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> ConfigSerializable for Twhere
T: Serialize + for<'de> Deserialize<'de>,
impl<T> ConfigSerializable for Twhere
T: Serialize + for<'de> Deserialize<'de>,
Source§fn save_to_file(&self, path: &Path) -> Result<(), TrustformersError>
fn save_to_file(&self, path: &Path) -> Result<(), TrustformersError>
Save to file
Source§fn load_from_file(path: &Path) -> Result<Self, TrustformersError>where
Self: Sized,
fn load_from_file(path: &Path) -> Result<Self, TrustformersError>where
Self: Sized,
Load from file
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more