Enum ExtActivation 

pub enum ExtActivation {
    LeakyRelu(f64),
    Swish(f64),
    Relu,
    Sigmoid,
    Tanh,
    Linear,
}

Extended activation functions with additional variants for f64 paths.

Variants

LeakyRelu(f64)

Leaky ReLU: max(alpha * x, x) where alpha is the negative slope.

Swish(f64)

Swish: x * sigmoid(beta * x). beta=1 recovers SiLU.

Relu

Standard ReLU.

Sigmoid

Logistic sigmoid.

Tanh

Hyperbolic tangent.

Linear

Identity.

Implementations

impl ExtActivation

pub fn apply(&self, x: f64) -> f64

Evaluate the activation function at x.

pub fn derivative(&self, x: f64) -> f64

Evaluate the derivative of the activation function at x.

pub fn apply_vec(&self, v: &mut [f64])

Apply elementwise to a vector in-place.

Trait Implementations

impl Clone for ExtActivation

fn clone(&self) -> ExtActivation

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ExtActivation

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for ExtActivation

fn eq(&self, other: &ExtActivation) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for ExtActivation