Expand description
Activation functions with forward and backward passes for tensor computations.
Provides element-wise activation functions (ReLU, LeakyReLU, Sigmoid, Tanh, Softmax, GELU, Swish) with both forward evaluation and gradient (backward) computation.
Structs§
- Activation
Config - Configuration for an activation function.
- Activation
Stats - Runtime statistics for a
TensorActivationinstance. - Tensor
Activation - Activation layer with forward/backward support and call statistics.
Enums§
- Activation
Type - Type of activation function.