pub struct MoeOptions {
pub selection: MoeSelectionOptions,
pub weights: MoeRouterWeightOptions,
pub forward: MoeExpertStrategy,
pub backward: MoeExpertStrategy,
pub combine_backward: MoeCombineGradientStrategy,
}Expand description
Actual complete local expert execution choices, with no implicit tuning or retry policy.
Fields§
§selection: MoeSelectionOptionsOriginal actual discrete selection policy.
weights: MoeRouterWeightOptionsOriginal actual continuous selected-weight policy, independent of correction bias.
forward: MoeExpertStrategyOriginal actual expert forward strategy.
backward: MoeExpertStrategyOriginal actual expert backward strategy.
combine_backward: MoeCombineGradientStrategyOriginal actual combine weight-gradient reduction strategy.
Trait Implementations§
Source§impl Clone for MoeOptions
impl Clone for MoeOptions
impl Copy for MoeOptions
Source§impl Debug for MoeOptions
impl Debug for MoeOptions
Source§impl PartialEq for MoeOptions
impl PartialEq for MoeOptions
impl StructuralPartialEq for MoeOptions
Auto Trait Implementations§
impl Freeze for MoeOptions
impl RefUnwindSafe for MoeOptions
impl Send for MoeOptions
impl Sync for MoeOptions
impl Unpin for MoeOptions
impl UnsafeUnpin for MoeOptions
impl UnwindSafe for MoeOptions
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more