pub struct RmsNormOp {
pub tokens: usize,
pub dim: usize,
pub eps: f32,
}Expand description
One concrete rms_norm invocation. Inputs:
x: tokens × dim activationw: dim weight (per-channel scale)eps: the usual RMSNorm epsilon
Output: tokens × dim, same dtype as input on every backend’s compute dtype (typically fp16 on Metal/CUDA, fp32 on CPU).
Fields§
§tokens: usize§dim: usize§eps: f32Trait Implementations§
Auto Trait Implementations§
impl Freeze for RmsNormOp
impl RefUnwindSafe for RmsNormOp
impl Send for RmsNormOp
impl Sync for RmsNormOp
impl Unpin for RmsNormOp
impl UnsafeUnpin for RmsNormOp
impl UnwindSafe for RmsNormOp
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more