Enum Activation 

pub enum Activation {
    Tanh,
    Relu,
    Sigmoid,
    Elu,
    Softsign,
    Linear,
}

Supported activation function variants.

Each variant implements apply(x) for the forward pass and derivative(fx) which takes the post-activation value.

Examples

use pc_rl_core::activation::Activation;

let act = Activation::Tanh;
let y = act.apply(0.5);
let dy = act.derivative(y);

Variants

Tanh

Hyperbolic tangent: output in (-1, 1).

Relu

Rectified linear unit: max(0, x).

Sigmoid

Logistic sigmoid: output in (0, 1).

Elu

Exponential linear unit: smooth in negatives, avoids dying neurons.

Softsign

Softsign: bounded in (-1, 1) with slower saturation than tanh. Preserves more gradient in high-saturation regions.

Linear

Identity function: output equals input.

Implementations

impl Activation

pub fn apply(&self, x: f64) -> f64

Applies the activation function to a single scalar value.

Parameters

• x - Pre-activation input value.

Returns

The activated output value.

pub fn derivative(&self, fx: f64) -> f64

Computes the derivative given the post-activation value.

Parameters

• fx - The post-activation value (output of apply).

Returns

The derivative at fx.

Trait Implementations

impl Clone for Activation

fn clone(&self) -> Activation

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Activation

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for Activation

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for Activation

fn eq(&self, other: &Activation) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for Activation

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl Copy for Activation

impl Eq for Activation

impl StructuralPartialEq for Activation