pub struct AdvancedQuantizationConfig {
pub method: QuantizationMethod,
pub block_size: usize,
pub adaptation_rate: f32,
pub min_scale: f32,
pub max_scale: f32,
pub double_quantization: bool,
}Expand description
Configuration for advanced quantization
Fields§
§method: QuantizationMethodQuantization method
block_size: usizeBlock size for block-wise quantization (default: 64)
adaptation_rate: f32Dynamic quantization adaptation rate (default: 0.01)
min_scale: f32Minimum scale factor to prevent underflow (default: 1e-8)
max_scale: f32Maximum scale factor to prevent overflow (default: 1e8)
double_quantization: boolUse double quantization for scale factors (default: true)
Trait Implementations§
Source§impl Clone for AdvancedQuantizationConfig
impl Clone for AdvancedQuantizationConfig
Source§fn clone(&self) -> AdvancedQuantizationConfig
fn clone(&self) -> AdvancedQuantizationConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for AdvancedQuantizationConfig
impl Debug for AdvancedQuantizationConfig
Source§impl Default for AdvancedQuantizationConfig
impl Default for AdvancedQuantizationConfig
Source§impl<'de> Deserialize<'de> for AdvancedQuantizationConfig
impl<'de> Deserialize<'de> for AdvancedQuantizationConfig
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for AdvancedQuantizationConfig
impl RefUnwindSafe for AdvancedQuantizationConfig
impl Send for AdvancedQuantizationConfig
impl Sync for AdvancedQuantizationConfig
impl Unpin for AdvancedQuantizationConfig
impl UnwindSafe for AdvancedQuantizationConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> ConfigSerializable for Twhere
T: Serialize + for<'de> Deserialize<'de>,
impl<T> ConfigSerializable for Twhere
T: Serialize + for<'de> Deserialize<'de>,
Source§fn save_to_file(&self, path: &Path) -> Result<(), TrustformersError>
fn save_to_file(&self, path: &Path) -> Result<(), TrustformersError>
Save to file
Source§fn load_from_file(path: &Path) -> Result<Self, TrustformersError>where
Self: Sized,
fn load_from_file(path: &Path) -> Result<Self, TrustformersError>where
Self: Sized,
Load from file
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more