1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
//! Auto-generated contract trait for `activation-kernel-v1`.
//! Generated by: `pv scaffold --trait contracts/activation-kernel-v1.yaml`
//! DO NOT EDIT — regenerate from YAML source.
/// Contract trait for `activation-kernel-v1` v1.0.0.
///
/// Activation functions — GELU, SiLU/Swish, ReLU kernels
/// Reference: Hendrycks & Gimpel (2016) Gaussian Error Linear Units (GELUs)
/// Reference: Ramachandran et al. (2017) Searching for Activation Functions (SiLU)
/// Reference: Nair & Hinton (2010) Rectified Linear Units Improve Restricted Boltzmann Machines
///
/// Implementors must provide all 3 equation(s).
/// Missing method = compile error. Wrong signature = compile error.