causal_softmax

smelte_rs::cpu::f32

Function causal_softmax 

Source 
pub fn causal_softmax(
    x: &mut Tensor<'_>,
    past_sequence_length: usize,
) -> Result<(), SmeltError>
Expand description

Causal softmax on the last dimension for tensor x. The causality is determined by the shape of x and past_sequence_length which defines how big is the missing part of the square.