pub struct MoeUnionRow {
pub t: usize,
pub slots: usize,
pub union_size: usize,
pub gu_us: f64,
pub down_us: f64,
pub gu_spread_rel: f64,
pub down_spread_rel: f64,
}Expand description
One row of the MoE routed-union cost probe (moeu lane, mtp13).
Fields§
§t: usizeVerify columns fed (t). 1 = the plain-decode reference shape.
slots: usize(token, expert) pairs dispatched = the grid.y extent of both launches.
union_size: usizeDISTINCT experts among those slots — the only quantity a union gather changes.
gu_us: f64Median us/launch of the fused gate+up+silu sel matvec.
down_us: f64Median us/launch of the down sel matvec.
gu_spread_rel: f64(max-min)/median over the arm’s reps. Reported so a reader can see whether an arm’s delta against another arm is inside its own noise; LAW:interleaved-ab wants every arm to report its spread, and at realistic union sizes this lever’s delta is smaller than this column.
down_spread_rel: f64Trait Implementations§
Source§impl Clone for MoeUnionRow
impl Clone for MoeUnionRow
Source§fn clone(&self) -> MoeUnionRow
fn clone(&self) -> MoeUnionRow
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for MoeUnionRow
Auto Trait Implementations§
impl Freeze for MoeUnionRow
impl RefUnwindSafe for MoeUnionRow
impl Send for MoeUnionRow
impl Sync for MoeUnionRow
impl Unpin for MoeUnionRow
impl UnsafeUnpin for MoeUnionRow
impl UnwindSafe for MoeUnionRow
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more