Struct dfdx::tensor_ops::RMSpropConfig

pub struct RMSpropConfig {
    pub lr: f64,
    pub alpha: f64,
    pub eps: f64,
    pub momentum: Option<f64>,
    pub centered: bool,
    pub weight_decay: Option<WeightDecay>,
}

Configuration of hyperparameters for crate::optim::RMSprop.

Fields

lr: f64

Learning rate. Defaults to 1e-2.

alpha: f64

Value for exponential moving average. Defaults to 0.9.

eps: f64

Epsilon for stability. Defaults to 1e-8.

momentum: Option<f64>

Optional momentum. Defaults to None.

centered: bool

Whether the avg should be centered by the grad’s avg value. Defaults to false.

weight_decay: Option<WeightDecay>

Optional weight decay. Defaults to None.

Implementations

impl RMSpropConfig

pub fn try_update<S: Shape, E: Dtype, D: RMSpropKernel<E>>( &self, param: &mut Tensor<S, E, D>, momentum: &mut D::Vec, square_avg: &mut D::Vec, grad_avg: &mut D::Vec, grad: &D::Vec ) -> Result<(), D::Err>

Update a single tensor using RMSprop.

Trait Implementations

impl Clone for RMSpropConfig

fn clone(&self) -> RMSpropConfig

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for RMSpropConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for RMSpropConfig

fn default() -> Self

Returns the “default value” for a type.

impl Copy for RMSpropConfig