pub enum MoeSelectionOptions {
Softmax {
top_k: usize,
renormalize: bool,
},
SigmoidGrouped {
top_k: usize,
groups: usize,
selected_groups: usize,
group_top_two: bool,
renormalize: bool,
scale: f32,
},
}Expand description
Original discrete expert selection. Correction bias affects selection only.
Variants§
Softmax
Original full softmax/top-k, with lower expert IDs resolving exact ties.
Fields
SigmoidGrouped
Original group-limited sigmoid selection with optional FP32 correction bias.
Fields
Trait Implementations§
Source§impl Clone for MoeSelectionOptions
impl Clone for MoeSelectionOptions
impl Copy for MoeSelectionOptions
Source§impl Debug for MoeSelectionOptions
impl Debug for MoeSelectionOptions
Source§impl PartialEq for MoeSelectionOptions
impl PartialEq for MoeSelectionOptions
impl StructuralPartialEq for MoeSelectionOptions
Auto Trait Implementations§
impl Freeze for MoeSelectionOptions
impl RefUnwindSafe for MoeSelectionOptions
impl Send for MoeSelectionOptions
impl Sync for MoeSelectionOptions
impl Unpin for MoeSelectionOptions
impl UnsafeUnpin for MoeSelectionOptions
impl UnwindSafe for MoeSelectionOptions
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more