pub struct ResidentExpertParallel { /* private fields */ }Expand description
Persistent expert-parallel reference.
Every routed expert has exactly one owner rank. Shared experts are deliberately absent from this object because Step replicates them per rank. Routes execute on the owner CUDA context. The default oracle stages through host memory; the native path peer-dispatches inputs and peer-returns owner outputs while preserving host-canonical activation and accumulation.
Auto Trait Implementations§
impl Freeze for ResidentExpertParallel
impl RefUnwindSafe for ResidentExpertParallel
impl Send for ResidentExpertParallel
impl Sync for ResidentExpertParallel
impl Unpin for ResidentExpertParallel
impl UnsafeUnpin for ResidentExpertParallel
impl UnwindSafe for ResidentExpertParallel
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more