Enum RowGate 

pub enum RowGate {
    Softmax {
        inv_tau: f64,
    },
    PerAtomLogistic {
        inv_tau: f64,
    },
}

The gate nonlinearity ζ(ℓ) of the SAE assignment, as the row program sees it. The production term carries the same two smooth branches (softmax over a shared partition; per-atom IBP/JumpReLU sigmoid); the program reproduces the branch the criterion evaluates so the value channel is the production gate.

Variants

Softmax

Shared softmax over all atom logits with inverse temperature inv_tau. ζ_k(ℓ) = softmax_k(ℓ · inv_tau).

Fields

inv_tau: f64

PerAtomLogistic

Per-atom independent logistic gate ζ_k(ℓ_k) = σ((ℓ_k − shift_k)·inv_tau) — the IBP-MAP / JumpReLU smooth activation (the per-atom shift_k folds the IBP stick-breaking offset or the JumpReLU threshold). Each gate depends only on its own logit, so the gate Hessian is diagonal.

Fields

inv_tau: f64

Trait Implementations

impl Clone for RowGate

fn clone(&self) -> RowGate

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for RowGate

impl Debug for RowGate

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.