Skip to main content

moe_block

Function moe_block 

Source
pub fn moe_block(
    model: &Arc<CmfModel>,
    jobs: &[MoeJob<'_>],
    out: &mut [f32],
) -> bool
Expand description

A layer’s MoE-FFN in one submission (amortizing the dispatch cost).