Enum ComponentType 

pub enum ComponentType {
    SGD,
    Adam,
    AdamW,
    RMSprop,
    AdaGrad,
    AdaDelta,
    Momentum,
    Nesterov,
    LRScheduler,
    GradientClipping,
    BatchNorm,
    Dropout,
    LAMB,
    LARS,
    Lion,
    RAdam,
    Lookahead,
    SAM,
    LBFGS,
    SparseAdam,
    GroupedAdam,
    MAML,
    L1Regularizer,
    L2Regularizer,
    ElasticNetRegularizer,
    DropoutRegularizer,
    WeightDecay,
    AdaptiveLR,
    AdaptiveMomentum,
    AdaptiveRegularization,
    LSTMOptimizer,
    TransformerOptimizer,
    AttentionOptimizer,
    MetaSGD,
    ConstantLR,
    ExponentialLR,
    StepLR,
    CosineAnnealingLR,
    OneCycleLR,
    CyclicLR,
    Reptile,
    Custom,
}

Types of optimizer components that can be used in architectures

Variants

SGD

Stochastic Gradient Descent

Adam

Adam optimizer

AdamW

AdamW (Adam with weight decay)

RMSprop

RMSprop optimizer

AdaGrad

AdaGrad optimizer

AdaDelta

AdaDelta optimizer

Momentum

Momentum component

Nesterov

Nesterov momentum

LRScheduler

Learning rate scheduler

GradientClipping

Gradient clipping

BatchNorm

Batch normalization

Dropout

Dropout regularization

LAMB

LAMB optimizer

LARS

LARS optimizer

Lion

Lion optimizer

RAdam

RAdam optimizer

Lookahead

Lookahead optimizer

SAM

SAM optimizer

LBFGS

L-BFGS optimizer

SparseAdam

Sparse Adam optimizer

GroupedAdam

Grouped Adam optimizer

MAML

MAML optimizer

L1Regularizer

L1 regularizer

L2Regularizer

L2 regularizer

ElasticNetRegularizer

Elastic Net regularizer

DropoutRegularizer

Dropout regularizer

WeightDecay

Weight decay

AdaptiveLR

Adaptive learning rate

AdaptiveMomentum

Adaptive momentum

AdaptiveRegularization

Adaptive regularization

LSTMOptimizer

LSTM optimizer

TransformerOptimizer

Transformer optimizer

AttentionOptimizer

Attention optimizer

MetaSGD

Meta SGD

ConstantLR

Constant learning rate

ExponentialLR

Exponential learning rate

StepLR

Step learning rate

CosineAnnealingLR

Cosine annealing learning rate

OneCycleLR

One cycle learning rate

CyclicLR

Cyclic learning rate

Reptile

Reptile optimizer

Custom

Custom component

Trait Implementations

impl Clone for ComponentType

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for ComponentType

impl Debug for ComponentType

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for ComponentType

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Display for ComponentType

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for ComponentType

impl Hash for ComponentType

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for ComponentType

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for ComponentType

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for ComponentType