Skip to main content

pre

memra_engine::hyper

Function pre 

Source 
pub fn pre(
    e: &Engine,
    topology: &HyperTopology,
    site: &HyperSite,
    x: &CudaSlice<f32>,
    t: usize,
    hidden: usize,
) -> Result<(CudaSlice<f32>, HcMix), Box<dyn Error>>
Expand description

One site’s pre-branch half (hc_pre): mixes GEMM, per-token RMS rescale, Sinkhorn, stream collapse. Returns the branch input [tokens, hidden] and the gates its post half needs.