Struct OnlineSoftmaxState 

pub struct OnlineSoftmaxState<E: Float> {
    pub max: Array<E>,
    pub sum: Array<E>,
}

Every slice’s running max and sum as they stand, undivided (OnlineSoftmax::state): what a holder writes beside its unnormalized sum against the values where another merges its slices with other holders’ parts of them.

Fields

max: Array<E>

Each slice’s running max, E::min_value() for a slice whose every cell so far is masked.

sum: Array<E>

Each slice’s running sum of exp(score − max), zero for a slice whose every cell so far is masked.

Trait Implementations

impl<E: Float> CubeType for OnlineSoftmaxState<E>

type ExpandType = OnlineSoftmaxStateExpand<E>