Skip to main content

Module load_balance

Module load_balance 

Source
Expand description

Tensor Distribution and Load Balancing for Ghost-Link Cluster

This module provides:

  • Tensor distribution across nodes based on VRAM capacity
  • Dynamic load shedding
  • Deadlock prevention with timeout
  • Dynamic reconfiguration on hardware changes via SystemProfileWatcher.

Structs§

LoadBalanceConfig
Load balancing configuration
LoadBalancer
Load balancer for tensor distribution
LoadDistributionPlan
Load distribution plan across nodes
LoadStats
Load statistics collector
TensorSlice
Tensor slice specification

Functions§

chunk_distribution_plan
Split large tensor slices in an existing distribution plan into smaller contiguous chunks.