Module corgi::activation

Activation functions are differentiable non-linearities applied to the output of layers.

Functions

relu

Creates a ReLU activation function closure.

sigmoid

Creates a sigmoid activation function closure.

softmax

Creates a softmax activation function closure.

Type Definitions

Activation

An activation function, which is applied to the output of a layer, and implements the differentiable activation operation.