Enum GateMode 

pub enum GateMode {
    Scalar,
    Vector,
}

Available on crate feature alloc only.

Gate dimensionality for GLA-family variants.

The original GLA paper (Yang et al., 2024) specifies a vector gate α_t ∈ (0,1)^{d_k} — one decay scalar per key dimension. The simplified scalar gate (Scalar) uses a single sigmoid output shared across all key dimensions, which reduces parameter count at the cost of expressivity.

Vector is the mathematically canonical form from the paper. Scalar is retained for backward compatibility with models trained before the vector-gate upgrade.

Variants

Scalar

Single scalar gate shared across all key dimensions (legacy default).

Vector

Per-key-dimension gate vector α_t ∈ (0,1)^{d_k} (paper-canonical).

Trait Implementations

impl Clone for GateMode

fn clone(&self) -> GateMode

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for GateMode

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for GateMode

fn eq(&self, other: &GateMode) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for GateMode