yscv-optim 0.1.7

Optimizers (SGD, Adam, LAMB), LR schedulers, and gradient clipping
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33

# yscv-optim

Optimizers, learning rate schedulers, and gradient clipping for neural network training.

```rust
use yscv_optim::*;

let mut optimizer = Adam::new(parameters, 1e-3);
let scheduler = CosineScheduler::new(100, 1e-3, 1e-6);

for epoch in 0..100 {
    optimizer.set_lr(scheduler.get_lr(epoch));
    optimizer.step();
    optimizer.zero_grad();
}
```

## Optimizers

SGD, Adam, AdamW, RMSprop, RAdam, LARS, LAMB, AdaGrad, Lookahead (wrapper)

## LR Schedulers

Step, MultiStep, Exponential, Cosine, CosineWarmRestart, Linear, Polynomial, OneCycle, ReduceOnPlateau, Warmup

## Gradient Clipping

- `clip_grad_norm` — L2 norm clipping
- `clip_grad_value` — element-wise value clipping

## Tests

76 tests covering optimizer convergence, scheduler curves, clipping behavior.