pub struct QuantizedBlock {
pub data: Vec<u8>,
pub scale: f32,
pub zero_point: i32,
pub bit_width: u8,
pub block_shape: Vec<usize>,
pub block_offset: Vec<usize>,
}Expand description
A block of quantized data with specific bit width
Fields§
§data: Vec<u8>Quantized data
scale: f32Scale factor
zero_point: i32Zero point
bit_width: u8Bit width used for this block
block_shape: Vec<usize>Block shape
block_offset: Vec<usize>Block offset in the original tensor
Trait Implementations§
Source§impl Clone for QuantizedBlock
impl Clone for QuantizedBlock
Source§fn clone(&self) -> QuantizedBlock
fn clone(&self) -> QuantizedBlock
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for QuantizedBlock
impl Debug for QuantizedBlock
Source§impl<'de> Deserialize<'de> for QuantizedBlock
impl<'de> Deserialize<'de> for QuantizedBlock
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for QuantizedBlock
impl RefUnwindSafe for QuantizedBlock
impl Send for QuantizedBlock
impl Sync for QuantizedBlock
impl Unpin for QuantizedBlock
impl UnsafeUnpin for QuantizedBlock
impl UnwindSafe for QuantizedBlock
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> ConfigSerializable for Twhere
T: Serialize + for<'de> Deserialize<'de>,
impl<T> ConfigSerializable for Twhere
T: Serialize + for<'de> Deserialize<'de>,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more