Enum GraphAct 

pub enum GraphAct {
    Silu,
    GeluErf,
}

Activation of a graph layer’s dense FFN, act(gate)·up. The code is the word the kernels read (silu_mul_pre‘s _c, the fused gate+up kernels’ _p1): 0 keeps the historical SiLU expression untouched.

Variants

Silu

GeluErf

Exact erf GELU (HF gelu), erf by Abramowitz–Stegun 7.1.26 — the formula inference::erf_f32 uses on the host.

Implementations

impl GraphAct

pub fn code(self) -> u32

Trait Implementations

impl Clone for GraphAct

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for GraphAct

impl Debug for GraphAct

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for GraphAct

impl PartialEq for GraphAct

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for GraphAct