Module optimizers
Source - AdaBound
- AdaBound optimizer configuration
- AdaDelta
- AdaDelta optimizer configuration
- Adagrad
- Adagrad optimizer
- Adam
- Adam optimizer
- AdamW
- AdamW optimizer
- GroupedAdam
- Adam optimizer with parameter group support
- LAMB
- LAMB (Layer-wise Adaptive Moments) optimizer
- LARS
- Layer-wise Adaptive Rate Scaling (LARS) optimizer
- LBFGS
- L-BFGS optimizer
- Lion
- Lion optimizer
- Lookahead
- Lookahead optimizer
- RAdam
- RAdam (Rectified Adam) optimizer
- RMSprop
- RMSprop optimizer
- Ranger
- Ranger optimizer configuration
- SAM
- Sharpness-Aware Minimization (SAM) optimizer
- SGD
- Stochastic Gradient Descent optimizer
- SimdSGD
- SIMD-accelerated Stochastic Gradient Descent optimizer
- SparseAdam
- SparseAdam optimizer for sparse gradients
- SparseGradient
- A struct representing a sparse gradient with indices and values
- Optimizer
- Trait that defines the interface for optimization algorithms