Enum ActivationFunction 

pub enum ActivationFunction {
    Sigmoid,
    Tanh,
    ReLU,
    GELU,
    Swish,
    Linear,
}

Activation functions for neural networks

Variants

Sigmoid

Sigmoid activation

Tanh

Hyperbolic tangent

ReLU

Rectified Linear Unit

GELU

Gaussian Error Linear Unit

Swish

Swish activation

Linear

Linear activation (identity)

Implementations

impl ActivationFunction

pub fn apply<F: Float>(&self, x: F) -> F

Apply activation function

pub fn derivative<F: Float>(&self, x: F) -> F

Apply derivative of activation function

Trait Implementations

impl Clone for ActivationFunction

fn clone(&self) -> ActivationFunction

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ActivationFunction

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.