pub struct MtpDev {
pub layer: LayerDev,
pub enorm: CudaSlice<f32>,
pub hnorm: CudaSlice<f32>,
pub norm: CudaSlice<f32>,
pub e_proj: CudaSlice<u8>,
pub h_proj: CudaSlice<u8>,
pub hc_head_fn: CudaSlice<f32>,
pub hc_head_base: Vec<f32>,
pub hc_head_scale: Vec<f32>,
}Expand description
MTP (NextN) block on the LAST stage (pp idiom: MTP -> last stage). Shares the trunk embed (host-gathered) and head; own norms/projections/block/hc_head (SEMANTICS §5).
Fields§
§layer: LayerDev§enorm: CudaSlice<f32>§hnorm: CudaSlice<f32>§norm: CudaSlice<f32>§e_proj: CudaSlice<u8>§h_proj: CudaSlice<u8>§hc_head_fn: CudaSlice<f32>§hc_head_base: Vec<f32>§hc_head_scale: Vec<f32>Auto Trait Implementations§
impl Freeze for MtpDev
impl RefUnwindSafe for MtpDev
impl Send for MtpDev
impl Sync for MtpDev
impl Unpin for MtpDev
impl UnsafeUnpin for MtpDev
impl UnwindSafe for MtpDev
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more