Enum ActivationType 

#[repr(i32)]
pub enum ActivationType {
    kRELU = 0,
    kSIGMOID = 1,
    kTANH = 2,
    kLEAKY_RELU = 3,
    kELU = 4,
    kSELU = 5,
    kSOFTSIGN = 6,
    kSOFTPLUS = 7,
    kCLIP = 8,
    kHARD_SIGMOID = 9,
    kSCALED_TANH = 10,
    kTHRESHOLDED_RELU = 11,
    kGELU_ERF = 12,
    kGELU_TANH = 13,
}

ActivationType

Enumerates the types of activation to perform in an activation layer.

Variants

kRELU = 0

< Rectified linear activation.

kSIGMOID = 1

< Sigmoid activation.

kTANH = 2

< TanH activation.

kLEAKY_RELU = 3

< LeakyRelu activation: x>=0 ? x : alpha * x.

kELU = 4

< Elu activation: x>=0 ? x : alpha * (exp(x) - 1).

kSELU = 5

< Selu activation: x>0 ? beta * x : beta * (alpha*exp(x) - alpha)

kSOFTSIGN = 6

< Softsign activation: x / (1+|x|)

kSOFTPLUS = 7

< Parametric softplus activation: alphalog(exp(betax)+1)

kCLIP = 8

< Clip activation: max(alpha, min(beta, x))

kHARD_SIGMOID = 9

< Hard sigmoid activation: max(0, min(1, alpha*x+beta))

kSCALED_TANH = 10

< Scaled tanh activation: alphatanh(betax)

kTHRESHOLDED_RELU = 11

< Thresholded ReLU activation: x>alpha ? x : 0

kGELU_ERF = 12

< GELU erf activation: 0.5 * x * (1 + erf(sqrt(0.5) * x))

kGELU_TANH = 13

< GELU tanh activation: 0.5 * x * (1 + tanh(sqrt(2/pi) * (0.044715F * pow(x, 3) + x)))

Trait Implementations

impl Clone for ActivationType

fn clone(&self) -> ActivationType

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl ExternType for ActivationType

type Id = (n, v, i, n, f, e, r, _1, (), A, c, t, i, v, a, t, i, o, n, T, y, p, e)

A type-level representation of the type’s C++ namespace and type name.

type Kind = Trivial

Either cxx::kind::Opaque or cxx::kind::Trivial.

impl From<ActivationType> for ActivationType

fn from(value: ActivationType) -> Self

Converts to this type from the input type.

impl Hash for ActivationType

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl Into<ActivationType> for ActivationType

fn into(self) -> ActivationType

Converts this type into the (usually inferred) input type.

impl PartialEq for ActivationType

fn eq(&self, other: &ActivationType) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for ActivationType

impl SharedPtrTarget for ActivationType

impl StructuralPartialEq for ActivationType

impl UniquePtrTarget for ActivationType

impl VectorElement for ActivationType

impl WeakPtrTarget for ActivationType