Struct Placement 

pub struct Placement {
    pub mode: MoeMode,
    pub prefix_layers: usize,
    pub bank_slots: usize,
    pub predicted_s: f64,
    pub reason: String,
}

A placement: the mode, how many MoE layers (from the first MoE layer) run on the whole-layer prefix path, and how many bank slots to allocate.

Fields

mode: MoeMode

prefix_layers: usize

bank_slots: usize

predicted_s: f64

Predicted seconds per token of the chosen mode (model only).

reason: String

Trait Implementations

impl Clone for Placement

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Placement

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for Placement

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for Placement