Expand description
Parallel Configuration
Configuration types for multi-GPU parallelism.
Structs§
- Layer
Distribution - Layer distribution configuration for pipeline parallelism
- Layer
Range - Range of layers assigned to a pipeline stage
- Parallel
Config - Parallel execution configuration
Enums§
- Parallelism
Type - Type of parallelism strategy