Struct MoeGradientSelection 

pub struct MoeGradientSelection {
    pub input: bool,
    pub logits: bool,
    pub gate: bool,
    pub up: bool,
    pub down: bool,
}

Actual first-order derivatives requested by the caller or tracked AD parents.

Fields

input: bool

Preserve upstream input derivatives independently of expert-weight trainability.

logits: bool

Original fixed-selection logits derivative.

gate: bool

Original FP32 gate cube derivative.

up: bool

Original FP32 up cube derivative.

down: bool

Original FP32 down cube derivative.

Trait Implementations

impl Clone for MoeGradientSelection

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for MoeGradientSelection

impl Debug for MoeGradientSelection

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for MoeGradientSelection

impl PartialEq for MoeGradientSelection

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for MoeGradientSelection