pub struct QuantizationParams {
pub scale: f32,
pub zero_point: i32,
pub qmin: i32,
pub qmax: i32,
pub src_dtype: DType,
pub dst_dtype: DType,
}Expand description
Quantization parameters
Fields§
§scale: f32Scale factor
zero_point: i32Zero point (for asymmetric quantization)
qmin: i32Minimum quantized value
qmax: i32Maximum quantized value
src_dtype: DTypeSource dtype
dst_dtype: DTypeTarget dtype
Implementations§
Source§impl QuantizationParams
impl QuantizationParams
Sourcepub fn symmetric(scale: f32, src_dtype: DType, dst_dtype: DType) -> Self
pub fn symmetric(scale: f32, src_dtype: DType, dst_dtype: DType) -> Self
Create symmetric quantization parameters
Sourcepub fn asymmetric(
scale: f32,
zero_point: i32,
src_dtype: DType,
dst_dtype: DType,
) -> Self
pub fn asymmetric( scale: f32, zero_point: i32, src_dtype: DType, dst_dtype: DType, ) -> Self
Create asymmetric quantization parameters
Sourcepub fn quantize(&self, tensor: &Tensor) -> Result<Tensor>
pub fn quantize(&self, tensor: &Tensor) -> Result<Tensor>
Quantize a tensor using these parameters
Sourcepub fn dequantize(&self, tensor: &Tensor) -> Result<Tensor>
pub fn dequantize(&self, tensor: &Tensor) -> Result<Tensor>
Dequantize a tensor using these parameters
Trait Implementations§
Source§impl Clone for QuantizationParams
impl Clone for QuantizationParams
Source§fn clone(&self) -> QuantizationParams
fn clone(&self) -> QuantizationParams
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreAuto Trait Implementations§
impl Freeze for QuantizationParams
impl RefUnwindSafe for QuantizationParams
impl Send for QuantizationParams
impl Sync for QuantizationParams
impl Unpin for QuantizationParams
impl UnsafeUnpin for QuantizationParams
impl UnwindSafe for QuantizationParams
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more