atomr-accel-train 0.3.3

Distributed training blueprints on atomr-accel-cuda: DataParallelTrainer, PipelineParallelTrainer, TensorParallelTrainer, AsyncParameterServer, optimizer + loss enums.
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33

# atomr-accel-train

Distributed training blueprints on [atomr-accel-cuda](../atomr-accel-cuda):
data-parallel, pipeline-parallel, tensor-parallel, async parameter
server, plus typed `OptimizerKind` / `LossKind` enums.

## Add to your project

```toml
[dependencies]
atomr-accel       = "0.0"
atomr-accel-train = "0.0"
```

```rust
use atomr_accel_train::prelude::*;
```

This crate depends on `atomr-accel-cuda` (foundation) plus
`atomr-accel-patterns` (for replica routing). Nothing else.

## What's inside

| Blueprint                  | Type                          |
|----------------------------|-------------------------------|
| Data parallel              | `DataParallelTrainer<P>`      |
| Pipeline parallel          | `PipelineParallelTrainer<P>`  |
| Tensor parallel            | `TensorParallelTrainer<P>`    |
| Async parameter server     | `AsyncParameterServer`        |
| Optimizer enum             | `OptimizerKind` (SGD, AdamW)  |
| Loss enum                  | `LossKind` (MSE, CrossEntropy) |

License: Apache-2.0.