Module pwl

Source

Modulesยง

approx_exponent
Exp(x) piecewise-linear approximation.
approx_gelu
GELU(x) piecewise-linear approximation.
approx_gelu_derivative
Derivative of GELU(x) piecewise-linear approximation.
approx_pointwise
approx_sigmoid
Sigmoid(x) piecewise-linear approximation.