Skip to main content

head

Function head 

Source
pub fn head(
    weights: &HyperConnectionHeadWeights,
    x: &[Vec<f32>; 4],
    rms_norm_eps: f32,
    hc_eps: f32,
) -> Vec<f32>
Expand description

build_hc_head: the final collapse of hc streams into one output vector before unembedding – structurally the pre-gate half of pre, with no post/comb since nothing follows it.