Expand description
AsyncParameterServer — central parameter store with async
gradient pushes and async weight pulls.
Workers push gradients (via PushGradient); the server applies
them with the configured optimizer and a staleness window.
Workers pull the latest weights (via PullWeights) on their
own schedule. Bounded-staleness training tolerates a few steps
of drift in exchange for higher worker utilization.