pub struct ModelQuantizationConfig {
pub ternary_config: TernaryConfig,
pub min_layer_size: usize,
pub skip_patterns: Vec<String>,
pub verbose: bool,
}Expand description
Configuration for model quantization.
Fields§
§ternary_config: TernaryConfigTernary quantization config
min_layer_size: usizeMinimum layer size to quantize (skip small layers)
skip_patterns: Vec<String>Skip layers matching these patterns
verbose: boolVerbose logging
Trait Implementations§
Source§impl Clone for ModelQuantizationConfig
impl Clone for ModelQuantizationConfig
Source§fn clone(&self) -> ModelQuantizationConfig
fn clone(&self) -> ModelQuantizationConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for ModelQuantizationConfig
impl Debug for ModelQuantizationConfig
Source§impl Default for ModelQuantizationConfig
impl Default for ModelQuantizationConfig
Source§fn default() -> ModelQuantizationConfig
fn default() -> ModelQuantizationConfig
Returns the “default value” for a type. Read more
Auto Trait Implementations§
impl Freeze for ModelQuantizationConfig
impl RefUnwindSafe for ModelQuantizationConfig
impl Send for ModelQuantizationConfig
impl Sync for ModelQuantizationConfig
impl Unpin for ModelQuantizationConfig
impl UnwindSafe for ModelQuantizationConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more