Struct MoeDescriptor 

pub struct MoeDescriptor {
    pub num_tokens: i32,
    pub num_experts: i32,
    pub top_k: i32,
    pub d_model: i32,
    pub d_expert: i32,
    pub variant: MoeVariant,
    pub block_format: Option<GgufBlockFormat>,
    pub element: ElementKind,
    pub is_prefill: bool,
}

Descriptor for an MoE forward op.

Fields

num_tokens: i32

Total number of tokens to process.

num_experts: i32

Number of experts in the MoE block.

top_k: i32

Number of experts each token is routed to (top_k in routing).

d_model: i32

Hidden dim of the activation / output (size_k in Fuel-speak).

d_expert: i32

Per-expert output feature dim (size_n in Fuel-speak).

variant: MoeVariant

Which kernel variant to dispatch.

block_format: Option<GgufBlockFormat>

GGUF block format — must be Some(...) for ScalarGguf / WmmaGguf variants and None for the Wmma variant.

element: ElementKind

Activation element type. F32 for ScalarGguf; F16 or Bf16 for Wmma / WmmaGguf.

is_prefill: bool

is_prefill flag for the Wmma variant (selects between prefill M=16 / N=16 / WARPS_N=2 and decode M=8 / N=32 / WARPS_N=1 tile geometries). Ignored by the other variants.

Trait Implementations

impl Clone for MoeDescriptor

fn clone(&self) -> MoeDescriptor

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for MoeDescriptor

impl Debug for MoeDescriptor

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.