pub enum MoeRouterScoring {
Softmax,
Sigmoid,
}Expand description
Original continuous weight scoring, independent of discrete expert selection.
Variants§
Softmax
FP32 softmax over every expert before selecting continuous weights.
Sigmoid
Original pointwise stable sigmoid scores.
Trait Implementations§
Source§impl Clone for MoeRouterScoring
impl Clone for MoeRouterScoring
Source§fn clone(&self) -> MoeRouterScoring
fn clone(&self) -> MoeRouterScoring
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for MoeRouterScoring
Source§impl Debug for MoeRouterScoring
impl Debug for MoeRouterScoring
impl Eq for MoeRouterScoring
Source§impl PartialEq for MoeRouterScoring
impl PartialEq for MoeRouterScoring
impl StructuralPartialEq for MoeRouterScoring
Auto Trait Implementations§
impl Freeze for MoeRouterScoring
impl RefUnwindSafe for MoeRouterScoring
impl Send for MoeRouterScoring
impl Sync for MoeRouterScoring
impl Unpin for MoeRouterScoring
impl UnsafeUnpin for MoeRouterScoring
impl UnwindSafe for MoeRouterScoring
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.