Skip to main content

LinearAttnLayer

memra_engine::hybrid

Struct LinearAttnLayer

pub struct LinearAttnLayer {
    pub wqkv: GpuTensor,
    pub wqkv_gate: GpuTensor,
    pub ssm_beta: GpuTensor,
    pub ssm_alpha: GpuTensor,
    pub ssm_a: GpuTensor,
    pub ssm_dt: GpuTensor,
    pub ssm_conv1d: GpuTensor,
    pub ssm_norm: GpuTensor,
    pub ssm_out: GpuTensor,
}

Fields§

§wqkv: GpuTensor§wqkv_gate: GpuTensor§ssm_beta: GpuTensor§ssm_alpha: GpuTensor§ssm_a: GpuTensor§ssm_dt: GpuTensor§ssm_conv1d: GpuTensor§ssm_norm: GpuTensor§ssm_out: GpuTensor

Auto Trait Implementations§

impl Freeze for LinearAttnLayer

impl RefUnwindSafe for LinearAttnLayer

impl Send for LinearAttnLayer

impl Sync for LinearAttnLayer

impl Unpin for LinearAttnLayer

impl UnsafeUnpin for LinearAttnLayer

impl UnwindSafe for LinearAttnLayer

Blanket Implementations§

impl<T> Any for T
where T: 'static + ?Sized,

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more

impl<T> Borrow<T> for T
where T: ?Sized,

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more

impl<T> BorrowMut<T> for T
where T: ?Sized,

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more

impl<T> From<T> for T

fn from(t: T) -> T

Returns the argument unchanged.

impl<T, U> Into<U> for T
where U: From<T>,

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

impl<T, U> TryFrom<U> for T
where U: Into<T>,

type Error = Infallible

The type returned in the event of a conversion error.

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.