Skip to main content

unsplit_head

Function unsplit_head 

Source
pub fn unsplit_head(d: &Tensor, which: usize) -> Result<Tensor>
Available on crate feature train only.
Expand description

split_heads backward for one of q/k/v (which in 0..3): d [h, t, hd] -> [t, 3c] with the other thirds zero.