Enum SoftmaxKind 

#[non_exhaustive]
#[repr(u16)]
pub enum SoftmaxKind {
    Softmax = 0,
    LogSoftmax = 1,
    GumbelSoftmax = 2,
    Sparsemax = 3,
}

Softmax-family op discriminant — category H from the comprehensive plan.

Stored as u16 in crate::KernelSku::op when category == OpCategory::Softmax. All variants apply a length-preserving transform along a single axis (output shape == input shape — distinct from reductions, like scans).

Today wired: {Softmax, LogSoftmax} × {f32, f16, bf16, f64} — FW + BW. GumbelSoftmax (needs RNG state from Phase 4 random) and Sparsemax (different gradient — projection onto simplex) are reserved-but-deferred.

Variants (Non-exhaustive)

Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.

Softmax = 0

y[k] = exp(x[k] - max(x)) / Σ_j exp(x[j] - max(x)) — numerically stable softmax.

LogSoftmax = 1

y[k] = x[k] - logsumexp(x) — log-domain softmax, also stable. Output is the elementwise log of Softmax(x).

GumbelSoftmax = 2

y = (x + Gumbel(0,1)) / τ → softmax — reserved.

Sparsemax = 3

y = ProjSimplex(x) — reserved (different gradient than softmax).

Trait Implementations

impl Clone for SoftmaxKind

fn clone(&self) -> SoftmaxKind

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for SoftmaxKind

impl Debug for SoftmaxKind

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Eq for SoftmaxKind

impl Hash for SoftmaxKind

fn hash<__H>(&self, state: &mut __H)

where __H: Hasher,

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for SoftmaxKind

fn eq(&self, other: &SoftmaxKind) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for SoftmaxKind