Skip to main content

MlpKernel

Trait MlpKernel 

Source
pub trait MlpKernel:
    Send
    + Sync
    + Debug {
    // Required method
    fn fused_swiglu(
        &self,
        gate: &TensorView<'_, f32>,
        up: &TensorView<'_, f32>,
        out: &mut TensorViewMut<'_, f32>,
    ) -> Result<(), KernelError>;
}

Required Methods§

Source

fn fused_swiglu( &self, gate: &TensorView<'_, f32>, up: &TensorView<'_, f32>, out: &mut TensorViewMut<'_, f32>, ) -> Result<(), KernelError>

Implementors§