pub struct QuantizeConfig {
pub skip_layers: Vec<String>,
pub min_size: usize,
pub num_levels: usize,
}Expand description
Quantization configuration
Fields§
§skip_layers: Vec<String>Layers to skip quantization (keep in full precision)
min_size: usizeMinimum tensor size to quantize (smaller tensors stay full precision)
num_levels: usizeNumber of quantization levels (256 for int8-like behavior)
Trait Implementations§
Source§impl Clone for QuantizeConfig
impl Clone for QuantizeConfig
Source§fn clone(&self) -> QuantizeConfig
fn clone(&self) -> QuantizeConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for QuantizeConfig
impl Debug for QuantizeConfig
Auto Trait Implementations§
impl Freeze for QuantizeConfig
impl RefUnwindSafe for QuantizeConfig
impl Send for QuantizeConfig
impl Sync for QuantizeConfig
impl Unpin for QuantizeConfig
impl UnwindSafe for QuantizeConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more