Struct RouterOutput 

pub struct RouterOutput {
    pub expert_ids: Vec<u32>,
    pub expert_weights: Vec<f32>,
}

Result of routing one batch: parallel arrays indexed [b * top_k + k].

Fields

expert_ids: Vec<u32>

Selected expert indices. expert_ids[b * top_k + k] ∈ [0, num_experts).

expert_weights: Vec<f32>

Combine weights. Same shape as expert_ids. If norm_topk_prob was true, the K weights for each token sum to 1; otherwise they’re the raw (post-softmax) probabilities of the selected experts.

Implementations

impl RouterOutput

pub fn batch(&self) -> usize

Number of tokens routed.

Trait Implementations

impl Clone for RouterOutput

fn clone(&self) -> RouterOutput

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for RouterOutput

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for RouterOutput

fn eq(&self, other: &RouterOutput) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for RouterOutput