pub struct StageGroupRequest {
pub layers: Range<usize>,
pub tensor: usize,
pub expert_parallel: bool,
}Expand description
One pipeline stage’s model-specific tensor/expert group.
Stage groups make odd physical card counts useful without pretending PP is TP. For example, three cards can run a TP1 dense-prefix stage followed by a TP2/EP2 MoE stage. The layer range is explicit because memory-balanced Step placement is not necessarily an equal layer split.
Fields§
§layers: Range<usize>§tensor: usize§expert_parallel: boolTrait Implementations§
Source§impl Clone for StageGroupRequest
impl Clone for StageGroupRequest
Source§fn clone(&self) -> StageGroupRequest
fn clone(&self) -> StageGroupRequest
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for StageGroupRequest
impl Debug for StageGroupRequest
impl Eq for StageGroupRequest
Source§impl PartialEq for StageGroupRequest
impl PartialEq for StageGroupRequest
impl StructuralPartialEq for StageGroupRequest
Auto Trait Implementations§
impl Freeze for StageGroupRequest
impl RefUnwindSafe for StageGroupRequest
impl Send for StageGroupRequest
impl Sync for StageGroupRequest
impl Unpin for StageGroupRequest
impl UnsafeUnpin for StageGroupRequest
impl UnwindSafe for StageGroupRequest
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more