Struct Softmax

pub struct Softmax<'src, 'dst> { /* private fields */ }

Computes the softmax function over a slice of floats.

The implementation uses a three-pass approach for numerical stability. See https://ogunlao.github.io/2020/04/26/you_dont_really_know_softmax.html. and https://arxiv.org/abs/2001.04438.

Implementations

impl<'src, 'dst> Softmax<'src, 'dst>

pub fn new(input: &'src [f32], output: &'dst mut [MaybeUninit<f32>]) -> Self

Construct a softmax operation which reads input and writes to to output.

pub fn new_mut(input: &'dst mut [f32]) -> Self

where 'dst: 'src,

Construct a softmax operation which updates input in place.

Trait Implementations

impl<'dst> SimdOp for Softmax<'_, 'dst>

type Output = &'dst mut [f32]

The normalized elements.

fn eval<I: Isa>(self, isa: I) -> Self::Output

Evaluate the operation using the given instruction set.

fn dispatch(self) -> Self::Output

where Self: Sized,

Dispatch this operation using the preferred ISA for the current platform.