Enum Slot 

pub enum Slot {
    Undecided,
    Off,
}

The per-pipeline state: undecided until the first forward, then off or on with its bank.

Variants

Undecided

Off

Implementations

impl Slot

pub fn is_undecided(&self) -> bool

pub fn is_on(&self) -> bool

Whether the bank is active.

pub fn is_dynamic(&self, li: usize, host_tail: bool) -> bool

Does layer li run its experts through the bank? host_tail = the walk reached this layer after a device graph prefix handed it over: with a bank present every such MoE layer takes the bank (a whole-layer per-op path would stream experts through the residency arena).

pub fn decide( layers: &[(usize, &MoeFfn)], n_layers: usize, graph_prefix: bool, ) -> Self

Decide the placement for a MiMo-V2 stack (layers = its MoE layers, by absolute index). Any other model is Off.

Trait Implementations

impl Default for Slot

fn default() -> Self

Returns the “default value” for a type.