pub struct VitLayer<'a> {
pub ln1_w: &'a [f32],
pub ln1_b: &'a [f32],
pub qkv: &'a [f32],
pub qkv_b: &'a [f32],
pub proj: &'a [f32],
pub proj_b: &'a [f32],
pub ln2_w: &'a [f32],
pub ln2_b: &'a [f32],
pub fc1: &'a [f32],
pub fc1_b: &'a [f32],
pub fc2: &'a [f32],
pub fc2_b: &'a [f32],
}Expand description
One pre-norm ViT block’s f32 weights for vit_encode: LayerNorm 1,
fused qkv [3d, d], proj [d, d], LayerNorm 2, fc1 [inter, d], fc2
[d, inter], each with its bias.
Fields§
§ln1_w: &'a [f32]§ln1_b: &'a [f32]§qkv: &'a [f32]§qkv_b: &'a [f32]§proj: &'a [f32]§proj_b: &'a [f32]§ln2_w: &'a [f32]§ln2_b: &'a [f32]§fc1: &'a [f32]§fc1_b: &'a [f32]§fc2: &'a [f32]§fc2_b: &'a [f32]Auto Trait Implementations§
impl<'a> Freeze for VitLayer<'a>
impl<'a> RefUnwindSafe for VitLayer<'a>
impl<'a> Send for VitLayer<'a>
impl<'a> Sync for VitLayer<'a>
impl<'a> Unpin for VitLayer<'a>
impl<'a> UnsafeUnpin for VitLayer<'a>
impl<'a> UnwindSafe for VitLayer<'a>
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more