Module distributed 

Distributed pipeline execution components

This module provides distributed execution capabilities including cluster management, fault tolerance, load balancing, and MapReduce-style operations.

Structs

ClusterConfig

Cluster configuration

ClusterManager

Distributed cluster manager

ClusterNode

Cluster node information

ClusterStatus

Cluster status information

DataShard

Data shard for distributed processing

DataTransferMetrics

Data transfer metrics

DistributedTask

Distributed task specification

ExecutionMetrics

Task execution metrics

FaultDetector

Fault detection and recovery

LoadBalancer

Load balancer component

MapReducePipeline

MapReduce-style distributed pipeline

MapReducePipelineTrained

Trained state for MapReduce pipeline

NodeLoad

Current node load metrics

NodeResources

Node resource specification

ResourceRequirements

Resource requirements for tasks

TaskConfig

Task execution configuration

TaskResult

Task execution result

Enums

FailureTolerance

Failure tolerance strategies

LoadBalancingStrategy

Load balancing strategies

NodeStatus

Node status enumeration

PartitioningStrategy

Data partitioning strategies

RecoveryStrategy

Recovery strategies for different failure types

TaskPriority

Task priority levels

TaskStatus

Task execution status

Type Aliases

NodeId

Distributed node identifier

TaskId

Distributed task identifier