Enum ActivationFunc 

pub enum ActivationFunc {
    ReLU,
    Sigmoid,
    Tanh,
    Softmax,
    LeakyReLU(f64),
}

Activation function types.

Variants

ReLU

Rectified Linear Unit: f(x) = max(0, x)

Sigmoid

Sigmoid function: f(x) = 1 / (1 + exp(-x))

Tanh

Hyperbolic tangent: f(x) = tanh(x)

Softmax

Softmax function (applied along the last dimension)

LeakyReLU(f64)

Leaky ReLU: f(x) = max(alpha * x, x)

Trait Implementations

impl Clone for ActivationFunc

fn clone(&self) -> ActivationFunc

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ActivationFunc

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for ActivationFunc

fn eq(&self, other: &ActivationFunc) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for ActivationFunc

impl StructuralPartialEq for ActivationFunc