pub struct QuantizationMetadata {
pub quant_type: String,
pub bits: u8,
pub block_size: Option<usize>,
pub symmetric: bool,
}Expand description
Quantization metadata
Fields§
§quant_type: StringQuantization type (e.g., “int8”, “int4”, “fp16”)
bits: u8Bits per weight
block_size: Option<usize>Block size for block quantization
symmetric: boolWhether symmetric quantization
Trait Implementations§
Source§impl Clone for QuantizationMetadata
impl Clone for QuantizationMetadata
Source§fn clone(&self) -> QuantizationMetadata
fn clone(&self) -> QuantizationMetadata
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for QuantizationMetadata
impl Debug for QuantizationMetadata
Source§impl Default for QuantizationMetadata
impl Default for QuantizationMetadata
Source§fn default() -> QuantizationMetadata
fn default() -> QuantizationMetadata
Returns the “default value” for a type. Read more
Source§impl<'de> Deserialize<'de> for QuantizationMetadata
impl<'de> Deserialize<'de> for QuantizationMetadata
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for QuantizationMetadata
impl RefUnwindSafe for QuantizationMetadata
impl Send for QuantizationMetadata
impl Sync for QuantizationMetadata
impl Unpin for QuantizationMetadata
impl UnsafeUnpin for QuantizationMetadata
impl UnwindSafe for QuantizationMetadata
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more