pub enum MatmulM {
All,
Rows(usize),
Deferred(DynScalar),
}Expand description
How many rows a OpParams::Matmul computes — the data-determined-M
state for sparse-MoE / capacity-buffer matmuls. m in OpParams::Matmul
is always the row capacity (buffer/stride/size); this says how many
of those rows to actually compute (<= m), the rest left zeroed.
Variants§
All
Compute every one of the m rows — the universal static default.
Rows(usize)
Compute exactly this many rows of the m-row capacity buffer. Set
when the count is known at compile (an input-determined extent) or
after a Self::Deferred is resolved at execute.
Deferred(DynScalar)
The row count is data-determined (a producer binds it mid-pass,
e.g. Op::NonZeroIndices’s per-expert token count) — resolve at
execute from produced_syms, then patch to Self::Rows.
Trait Implementations§
impl Eq for MatmulM
impl StructuralPartialEq for MatmulM
Auto Trait Implementations§
impl Freeze for MatmulM
impl RefUnwindSafe for MatmulM
impl Send for MatmulM
impl Sync for MatmulM
impl Unpin for MatmulM
impl UnsafeUnpin for MatmulM
impl UnwindSafe for MatmulM
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§fn in_current_span(self) -> Instrumented<Self> ⓘ
fn in_current_span(self) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more