Enum CommunicationProtocol 

#[non_exhaustive]
pub enum CommunicationProtocol {
    DataStore,
    Direct,
    Pipeline {
        micro_batch_size: usize,
    },
}

How model-parallel partitions communicate activations and gradients.

Variants (Non-exhaustive)

Non-exhaustive enums could have additional variants added in future. Therefore, when matching against variants of non-exhaustive enums, an extra wildcard arm must be added to account for any future variants.

DataStore

Intermediate values flow via DataStore (S3, shared disk).

Direct

Direct point-to-point streaming between workers.

Pipeline

Pipeline parallelism with micro-batching for overlap.

Fields

micro_batch_size: usize

Trait Implementations

impl Clone for CommunicationProtocol

fn clone(&self) -> CommunicationProtocol

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CommunicationProtocol

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for CommunicationProtocol

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for CommunicationProtocol

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.