Enum ActivationFunction 

#[non_exhaustive]
pub enum ActivationFunction {
    Sigmoid,
    Tanh,
    ReLU,
    BinaryStep,
    Identity,
}

The function a layer applies to each neuron’s weighted sum.

Every layer of a crate::NeuralNetwork has its own, so hidden layers and the output layer can differ: a common choice is ReLU or Tanh for hidden layers, with Tanh for outputs in [-1, 1], Sigmoid for outputs in [0, 1], or Identity for unbounded outputs.

Variants (Non-exhaustive)

Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.

Sigmoid

1 / (1 + e^-x), in (0, 1).

Tanh

tanh(x), in (-1, 1).

ReLU

max(x, 0).

BinaryStep

1 for x >= 0, else 0.

Identity

x, unchanged.

Implementations

impl ActivationFunction

pub const ALL: [ActivationFunction; 5]

Every activation function, in declaration order.

pub fn apply(self, x: f64) -> f64

Applies the function to x.

assert_eq!(ActivationFunction::ReLU.apply(-2.0), 0.0);
assert_eq!(ActivationFunction::Identity.apply(-2.0), -2.0);

Trait Implementations

impl Clone for ActivationFunction

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for ActivationFunction

impl Debug for ActivationFunction

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ActivationFunction

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for ActivationFunction

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Eq for ActivationFunction

impl Hash for ActivationFunction

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for ActivationFunction

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl Serialize for ActivationFunction

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for ActivationFunction