Struct TopologyRequest 

pub struct TopologyRequest {
    pub pipeline: usize,
    pub tensor: usize,
    pub expert_parallel: bool,
    pub available_devices: usize,
    pub hardware: HardwareTarget,
}

Fields

pipeline: usize

tensor: usize

expert_parallel: bool

Routed experts are partitioned across the TP group. When false, each rank owns every expert and tensor-shards the expert projections instead.

available_devices: usize

hardware: HardwareTarget

Implementations

impl TopologyRequest

pub fn world_size(self) -> Result<usize, TopologyError>

Trait Implementations

impl Clone for TopologyRequest

fn clone(&self) -> TopologyRequest

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for TopologyRequest

impl Debug for TopologyRequest

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for TopologyRequest

impl PartialEq for TopologyRequest

fn eq(&self, other: &TopologyRequest) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for TopologyRequest