Enum LoopNorm 

pub enum LoopNorm {
    Output,
    Weightless,
}

A model whose logical layers are n_loops passes over n_phys physical ones. Only ever constructed with n_loops >= 2: a file declaring 1 (or nothing) is a plain model and carries None. The norm a pass boundary applies to the residual, if any.

Variants

Output

output_norm, the model’s own weighted final norm (nanbeige.cpp:167-175).

Weightless

A WEIGHTLESS RMS: hrm-text.cpp:162 closes every stack with build_norm(cur, nullptr, nullptr, LLM_NORM_RMS, ...), and the architecture has no output_norm tensor at all – the last stack’s norm IS the final one.

Trait Implementations

impl Clone for LoopNorm

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for LoopNorm

impl Debug for LoopNorm

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for LoopNorm

impl PartialEq for LoopNorm

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for LoopNorm