pub enum QuantizationType {
Int8,
UInt8,
Float16,
Int4,
}Expand description
Quantization type
Variants§
Int8
8-bit signed integer quantization
UInt8
8-bit unsigned integer quantization
Float16
16-bit floating point quantization
Int4
4-bit quantization (experimental)
Trait Implementations§
Source§impl Clone for QuantizationType
impl Clone for QuantizationType
Source§fn clone(&self) -> QuantizationType
fn clone(&self) -> QuantizationType
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for QuantizationType
impl Debug for QuantizationType
Source§impl PartialEq for QuantizationType
impl PartialEq for QuantizationType
impl Copy for QuantizationType
impl Eq for QuantizationType
impl StructuralPartialEq for QuantizationType
Auto Trait Implementations§
impl Freeze for QuantizationType
impl RefUnwindSafe for QuantizationType
impl Send for QuantizationType
impl Sync for QuantizationType
impl Unpin for QuantizationType
impl UnsafeUnpin for QuantizationType
impl UnwindSafe for QuantizationType
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more