pub struct GraphLayer<'a> {
pub input_norm: &'a [f32],
pub attn: GraphAttn<'a>,
pub post_norm: &'a [f32],
pub ffn: GraphFfn<'a>,
pub attn_out_norm: Option<&'a [f32]>,
pub ffn_out_norm: Option<&'a [f32]>,
pub layer_scale: Option<f32>,
}Expand description
Per-layer weights for the whole-token wgpu graph.
Fields§
§input_norm: &'a [f32]§attn: GraphAttn<'a>§post_norm: &'a [f32]§ffn: GraphFfn<'a>§attn_out_norm: Option<&'a [f32]>Gemma sandwich norms: the token mixer’s output and the FFN’s output are RMS-normed with these weights before their residual adds.
ffn_out_norm: Option<&'a [f32]>§layer_scale: Option<f32>Gemma-4 layer_scalar: the residual stream is multiplied by it at
the end of the layer.
Auto Trait Implementations§
impl<'a> Freeze for GraphLayer<'a>
impl<'a> RefUnwindSafe for GraphLayer<'a>
impl<'a> Send for GraphLayer<'a>
impl<'a> Sync for GraphLayer<'a>
impl<'a> Unpin for GraphLayer<'a>
impl<'a> UnsafeUnpin for GraphLayer<'a>
impl<'a> UnwindSafe for GraphLayer<'a>
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more