pub enum QuantType {
Q8_0,
Q4_0,
}Expand description
Quantization format type.
Variants§
Q8_0
8-bit quantization with FP16 scale per 32 elements.
Q4_0
4-bit quantization with FP16 scale per 32 elements.
Trait Implementations§
impl Copy for QuantType
impl Eq for QuantType
impl StructuralPartialEq for QuantType
Auto Trait Implementations§
impl Forget for QuantType
impl Freeze for QuantType
impl Move for QuantType
impl RefUnwindSafe for QuantType
impl Send for QuantType
impl Sync for QuantType
impl Unpin for QuantType
impl UnsafeUnpin for QuantType
impl UnwindSafe for QuantType
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more