pub struct MixedPrecisionConfig {
pub enabled: bool,
pub loss_scale: Float,
pub dynamic_loss_scaling: bool,
pub initial_loss_scale: Float,
pub growth_factor: Float,
pub backoff_factor: Float,
pub growth_interval: usize,
pub fp32_operations: Vec<String>,
pub use_amp: bool,
pub gradient_clip_threshold: Option<Float>,
}Expand description
Mixed precision configuration
Fields§
§enabled: boolEnable mixed precision training
loss_scale: FloatLoss scaling factor to prevent gradient underflow
dynamic_loss_scaling: boolDynamic loss scaling
initial_loss_scale: FloatInitial loss scale for dynamic scaling
growth_factor: FloatGrowth factor for loss scaling
backoff_factor: FloatBackoff factor when overflow is detected
growth_interval: usizeNumber of steps without overflow before increasing scale
fp32_operations: Vec<String>Operations to keep in FP32 (for numerical stability)
use_amp: boolUse automatic mixed precision (AMP)
gradient_clip_threshold: Option<Float>Gradient clipping threshold
Trait Implementations§
Source§impl Clone for MixedPrecisionConfig
impl Clone for MixedPrecisionConfig
Source§fn clone(&self) -> MixedPrecisionConfig
fn clone(&self) -> MixedPrecisionConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for MixedPrecisionConfig
impl Debug for MixedPrecisionConfig
Auto Trait Implementations§
impl Freeze for MixedPrecisionConfig
impl RefUnwindSafe for MixedPrecisionConfig
impl Send for MixedPrecisionConfig
impl Sync for MixedPrecisionConfig
impl Unpin for MixedPrecisionConfig
impl UnwindSafe for MixedPrecisionConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more