Struct ParallelResidual 

pub struct ParallelResidual {
    pub arch: &'static str,
    pub norm: ParallelNorm,
    pub when: ParallelWhen,
    pub second_norm: Option<&'static str>,
    pub lines: &'static str,
}

One graph that builds the parallel residual.

Fields

arch: &'static str

norm: ParallelNorm

The arm a parallel layer takes when second_norm is absent or None.

when: ParallelWhen

second_norm: Option<&'static str>

A per-layer OPTIONAL tensor whose presence turns the layer into the two-norm arm: falcon.cpp:35-36,79-85’s attn_norm_2, which norms the layer input FOR ATTENTION while attn_norm keeps feeding the FFN (crate::norm_sites::ATTN_NORM_2_FEEDS_ATTENTION crosses the two slots on such a layer).

lines: &'static str

Trait Implementations

impl Clone for ParallelResidual

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for ParallelResidual

impl Debug for ParallelResidual

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.