pub enum MoEExecMode {
Reuse,
Refresh,
}Expand description
Per-forward hint from the runner (maps to TIDE refresh_experts).
Variants§
Reuse
Reuse current GPU/CPU placement (moe_infer).
Refresh
Recompute placement from this step’s routing (moe_infer_with_expert_refresh).
Trait Implementations§
Source§impl Clone for MoEExecMode
impl Clone for MoEExecMode
Source§fn clone(&self) -> MoEExecMode
fn clone(&self) -> MoEExecMode
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for MoEExecMode
impl Debug for MoEExecMode
Source§impl PartialEq for MoEExecMode
impl PartialEq for MoEExecMode
Source§fn eq(&self, other: &MoEExecMode) -> bool
fn eq(&self, other: &MoEExecMode) -> bool
Tests for
self and other values to be equal, and is used by ==.impl Copy for MoEExecMode
impl Eq for MoEExecMode
impl StructuralPartialEq for MoEExecMode
Auto Trait Implementations§
impl Freeze for MoEExecMode
impl RefUnwindSafe for MoEExecMode
impl Send for MoEExecMode
impl Sync for MoEExecMode
impl Unpin for MoEExecMode
impl UnsafeUnpin for MoEExecMode
impl UnwindSafe for MoEExecMode
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more