Skip to main content

unsplit_head

Function unsplit_head 

Source
pub fn unsplit_head(d: &Tensor, which: usize) -> Result<Tensor>
Expand description

split_heads backward for one of q/k/v (which in 0..3): d [h, t, hd] -> [t, 3c] with the other thirds zero.