Module utils 

Functions

heavyside

Heaviside activation function:

linear

the linear method is essentially a passthrough method often used in simple models or layers where no activation is needed.

linear_derivative

the linear_derivative method always returns 1 as it is a simple, single variable function

relu

the relu activation function:

relu_derivative

sigmoid

the sigmoid activation function:

sigmoid_derivative

the derivative of the sigmoid function

softmax

Softmax function:

softmax_axis

Softmax function along a specific axis:

tanh

Hyperbolic tangent

tanh_derivative

the derivative of the tanh function