pub struct ParallelMapping {
pub tp_size: u32,
pub pp_size: u32,
pub attention_dp_size: Option<u32>,
pub moe_tp_size: Option<u32>,
pub moe_ep_size: Option<u32>,
pub cp_size: Option<u32>,
}Expand description
Parallelism layout. Flattened into EngineConfig so the flat wire keys
(tp_size, pp_size, …) parse unchanged.
Fields§
§tp_size: u32§pp_size: u32§attention_dp_size: Option<u32>§moe_tp_size: Option<u32>§moe_ep_size: Option<u32>§cp_size: Option<u32>Context-parallel size. Part of the engine identity so cp variants get
distinct compiled handles. None/1 means no CP. The per-op CP math is
carried on the ops themselves (seq_split / cp_size / attn_cp_size), not
re-derived from this field.
Trait Implementations§
Source§impl Clone for ParallelMapping
impl Clone for ParallelMapping
Source§fn clone(&self) -> ParallelMapping
fn clone(&self) -> ParallelMapping
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for ParallelMapping
impl Debug for ParallelMapping
Source§impl<'de> Deserialize<'de> for ParallelMapping
impl<'de> Deserialize<'de> for ParallelMapping
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl PartialEq for ParallelMapping
impl PartialEq for ParallelMapping
Source§impl Serialize for ParallelMapping
impl Serialize for ParallelMapping
impl StructuralPartialEq for ParallelMapping
Auto Trait Implementations§
impl Freeze for ParallelMapping
impl RefUnwindSafe for ParallelMapping
impl Send for ParallelMapping
impl Sync for ParallelMapping
impl Unpin for ParallelMapping
impl UnsafeUnpin for ParallelMapping
impl UnwindSafe for ParallelMapping
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more