Enum cogent::Activation

pub enum Activation {
    Sigmoid,
    Tanh,
    Softmax,
    ReLU,
}

Defines the activation of a layer.

Variants

Sigmoid

Sigmoid activation functions.

$ A(z)=\frac{1}{1+e^{-z}} $

Tanh

Tanh activation functions.

$ A(z)=\frac{2}{1+e^{-2z}}-1 $

Softmax

Softmax activation function.

$ A(\begin{bmatrix}z_1,\dots,z_k\end{bmatrix})=\begin{bmatrix}\frac{e^{z_1}}{\Sigma_{i=1}^k e^{z_i}} & \dots &\frac{e^{z_k}}{\Sigma_{i=1}^k e^{z_i}}\end{bmatrix} $

ReLU

ReLU activation function.

$ A(z)=max(z,0) $

Implementations

impl Activation

pub fn run(&self, z: &Array<f32>) -> Array<f32>

Computes activations given inputs (A(z)).

pub fn derivative(&self, z: &Array<f32>) -> Array<f32>

Derivative w.r.t. layer input (∂a/∂z).

Trait Implementations

impl Clone for Activation

fn clone(&self) -> Activation

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for Activation

impl Debug for Activation

fn fmt(&self, f: &mut Formatter) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for Activation

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error> where
    __D: Deserializer<'de>, 

Deserialize this value from the given Serde deserializer.

impl Serialize for Activation

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error> where
    __S: Serializer, 

Serialize this value into the given Serde serializer.