pub struct GraphMhc<'a> {
pub attn_w: &'a [f32],
pub attn_b: &'a [f32],
pub ffn_w: &'a [f32],
pub ffn_b: &'a [f32],
pub enter: bool,
pub leave: bool,
pub iters: usize,
pub pre_scale: f32,
}Expand description
Per-layer weights for the whole-token wgpu graph.
SenseNova-Loop mHC of one graph layer (two streams, sensenova::Mhc):
the attention and FFN routers ([8, 2·hidden] f32 and their biases),
whether this layer opens the range (copies the hidden into both
streams) or closes it (hands the streams’ mean on), the Sinkhorn
iterations and the branch scale.
Fields§
§attn_w: &'a [f32]§attn_b: &'a [f32]§ffn_w: &'a [f32]§ffn_b: &'a [f32]§enter: bool§leave: bool§iters: usize§pre_scale: f32Trait Implementations§
Auto Trait Implementations§
impl<'a> Freeze for GraphMhc<'a>
impl<'a> RefUnwindSafe for GraphMhc<'a>
impl<'a> Send for GraphMhc<'a>
impl<'a> Sync for GraphMhc<'a>
impl<'a> Unpin for GraphMhc<'a>
impl<'a> UnsafeUnpin for GraphMhc<'a>
impl<'a> UnwindSafe for GraphMhc<'a>
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more