Expand description
Tensor Distribution and Load Balancing for Ghost-Link Cluster
This module provides:
- Tensor distribution across nodes based on VRAM capacity
- Dynamic load shedding
- Deadlock prevention with timeout
- Dynamic reconfiguration on hardware changes via
SystemProfileWatcher.
Structs§
- Load
Balance Config - Load balancing configuration
- Load
Balancer - Load balancer for tensor distribution
- Load
Distribution Plan - Load distribution plan across nodes
- Load
Stats - Load statistics collector
- Tensor
Slice - Tensor slice specification
Functions§
- chunk_
distribution_ plan - Split large tensor slices in an existing distribution plan into smaller contiguous chunks.