Optimizers โ plain tensor arithmetic over the general runtime. Adam keeps per-parameter first/ second moment estimates and applies bias-corrected updates entirely on the GPU.