Module alumina::opt::cain [] [src]

Structs

Cain

Cosine Adapted Something Something, a first order optimiser based on ADAM, but with adaptive batch size and step size. Step length is adapted based on the cosine of the derivative vectors of subsequent steps. Each step consists of several sub-batchs () Nil convergence guarantees.

CainBuilder