Struct DynamicLossScaler 

pub struct DynamicLossScaler { /* private fields */ }

Dynamic loss scaler with the standard grow/back-off schedule.

Implementations

impl DynamicLossScaler

pub const WINDOW: usize = 100

Rolling window length used for Self::overflow_stats.

pub fn new(config: MixedPrecisionConfig) -> Self

Create a scaler from a configuration.

pub fn scale(&self) -> f32

Scale currently in effect.

pub fn inv_scale(&self) -> f32

Reciprocal of the current scale, for unscaling gradients.

pub fn update(&mut self, has_overflow: bool)

Record the outcome of one step and update the scale.

pub fn overflow_stats(&self) -> OverflowStats

Statistics over the rolling window.

pub fn unscale_and_check(&mut self, values: &mut [f32]) -> bool

Divide values by the current scale, reporting whether the scaled input contained a non-finite entry.

This is the standard AMP overflow test: an inf/NaN produced by the scaled backward pass means the step must be skipped and the scale cut.

Trait Implementations

impl Clone for DynamicLossScaler

fn clone(&self) -> DynamicLossScaler

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for DynamicLossScaler

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.