pub enum QuantizationSupport {
None,
Int8,
FP16,
BF16,
Int4,
Mixed,
}Expand description
Quantization support levels
Variants§
None
No quantization support
Int8
8-bit integer quantization
FP16
16-bit floating point
BF16
Brain floating point
Int4
4-bit quantization
Mixed
Mixed precision
Trait Implementations§
Source§impl Clone for QuantizationSupport
impl Clone for QuantizationSupport
Source§fn clone(&self) -> QuantizationSupport
fn clone(&self) -> QuantizationSupport
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for QuantizationSupport
impl Debug for QuantizationSupport
Source§impl PartialEq for QuantizationSupport
impl PartialEq for QuantizationSupport
impl Copy for QuantizationSupport
impl StructuralPartialEq for QuantizationSupport
Auto Trait Implementations§
impl Freeze for QuantizationSupport
impl RefUnwindSafe for QuantizationSupport
impl Send for QuantizationSupport
impl Sync for QuantizationSupport
impl Unpin for QuantizationSupport
impl UnwindSafe for QuantizationSupport
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> Pointable for T
impl<T> Pointable for T
Source§impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
Source§fn to_subset(&self) -> Option<SS>
fn to_subset(&self) -> Option<SS>
The inverse inclusion map: attempts to construct
self from the equivalent element of its
superset. Read moreSource§fn is_in_subset(&self) -> bool
fn is_in_subset(&self) -> bool
Checks if
self is actually part of its subset T (and can be converted to it).Source§fn to_subset_unchecked(&self) -> SS
fn to_subset_unchecked(&self) -> SS
Use with care! Same as
self.to_subset but without any property checks. Always succeeds.Source§fn from_subset(element: &SS) -> SP
fn from_subset(element: &SS) -> SP
The inclusion map: converts
self to the equivalent element of its superset.