Module softmax 

The softmax reading of a Tile: OnlineSoftmax takes a score where its holder keeps it, the ownership read off the score.

Structs

OnlineSoftmax

The running max m and sum l of every slice along axis of a score, in the registers of its holder.

OnlineSoftmaxExpand

OnlineSoftmaxState

Every slice’s running max and sum as they stand, undivided (OnlineSoftmax::state): what a holder writes beside its unnormalized sum against the values where another merges its slices with other holders’ parts of them.

OnlineSoftmaxStateExpand

RelayedFactors

What a plane’s sum and the carry’s rows are multiplied by in its cube’s turn at a Relay (OnlineSoftmax::relayed), one factor a slice each, before the sum drains into the carry.

RelayedFactorsExpand