Enum FusionPattern 

pub enum FusionPattern {
    MatMulBias,
    MatMulBiasRelu,
    MatMulBiasGelu,
    ConvBatchNorm,
    ConvBatchNormRelu,
    ElementwiseChain,
    Softmax,
    LayerNorm,
    GeluApprox,
    AddRelu,
    MulAdd,
}

Common fusion patterns.

Variants

MatMulBias

MatMul followed by bias addition.

MatMulBiasRelu

MatMul followed by bias addition and ReLU.

MatMulBiasGelu

MatMul followed by bias addition and GELU.

ConvBatchNorm

Convolution followed by batch normalization.

ConvBatchNormRelu

Convolution followed by batch normalization and ReLU.

ElementwiseChain

Multiple elementwise operations.

Softmax

Softmax pattern (exp, sum, div).

LayerNorm

Layer normalization pattern.

GeluApprox

GELU approximation pattern.

AddRelu

Add followed by ReLU.

MulAdd

Multiply followed by add (FMA).

Implementations

impl FusionPattern

pub fn num_ops(&self) -> usize

Returns the number of operations fused in this pattern.

pub fn estimated_speedup(&self) -> f32

Returns estimated speedup from this fusion.

pub fn is_memory_bound(&self) -> bool

Returns whether this pattern is memory-bound (vs compute-bound).

Trait Implementations

impl Clone for FusionPattern

fn clone(&self) -> FusionPattern

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for FusionPattern

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for FusionPattern

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Hash for FusionPattern

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for FusionPattern

fn eq(&self, other: &FusionPattern) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for FusionPattern

impl Eq for FusionPattern

impl StructuralPartialEq for FusionPattern