Skip to main content

expand

Function expand 

Source
pub fn expand(
    e: &Engine,
    topology: &HyperTopology,
    embedded: &CudaSlice<f32>,
    t: usize,
    hidden: usize,
) -> Result<CudaSlice<f32>, Box<dyn Error>>
Expand description

Model entry (hc_expand): [tokens, hidden] embeddings -> [tokens, streams, hidden].