Enum ElemOp 

pub enum ElemOp {
    Neg,
    Abs,
    Exp,
    Log,
    Sin,
    Cos,
    Sqrt,
    Sqr,
    Recip,
    Tanh,
    Sigmoid,
    ReLU,
    Gelu,
    Elu,
    Selu,
    Softplus,
    Sign,
}

Element-wise operation types

Variants

Neg

Negation: -x

Abs

Absolute value: |x|

Exp

Exponential: e^x

Log

Natural logarithm: ln(x)

Sin

Sine: sin(x)

Cos

Cosine: cos(x)

Sqrt

Square root: sqrt(x)

Sqr

Power of 2: x^2

Recip

Reciprocal: 1/x

Tanh

Hyperbolic tangent: tanh(x)

Sigmoid

Sigmoid: 1 / (1 + e^(-x))

ReLU

Rectified Linear Unit: max(0, x)

Gelu

Gaussian Error Linear Unit: x * Φ(x) where Φ is the CDF of standard normal Approximation: 0.5 * x * (1 + tanh(sqrt(2/π) * (x + 0.044715 * x^3)))

Elu

Exponential Linear Unit: x if x > 0, else e^x - 1

Selu

Scaled Exponential Linear Unit: scale * (x if x > 0, else alpha * (e^x - 1)) where scale ≈ 1.0507, alpha ≈ 1.67326

Softplus

Softplus: ln(1 + e^x)

Sign

Sign function: -1 if x < 0, 0 if x == 0, 1 if x > 0

Trait Implementations

impl Clone for ElemOp

fn clone(&self) -> ElemOp

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ElemOp

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.