Skip to main content

Hy3Layer0Stages

memra_engine::decode

Struct Hy3Layer0Stages

pub struct Hy3Layer0Stages {
    pub attention_output: CudaSlice<f32>,
    pub after_attention: CudaSlice<f32>,
    pub mlp_output: CudaSlice<f32>,
    pub residual: CudaSlice<f32>,
}

Expand description

Diagnostic-only snapshots of Hy3 layer 0 in the eager T=1 serving path. Each buffer is one residual-width device row captured before the next stage can reuse it.

Fields§

§attention_output: CudaSlice<f32>§after_attention: CudaSlice<f32>§mlp_output: CudaSlice<f32>§residual: CudaSlice<f32>

Auto Trait Implementations§

impl Freeze for Hy3Layer0Stages

impl RefUnwindSafe for Hy3Layer0Stages

impl Send for Hy3Layer0Stages

impl Sync for Hy3Layer0Stages

impl Unpin for Hy3Layer0Stages

impl UnsafeUnpin for Hy3Layer0Stages

impl UnwindSafe for Hy3Layer0Stages

Blanket Implementations§

impl<T> Any for T
where T: 'static + ?Sized,

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more

impl<T> Borrow<T> for T
where T: ?Sized,

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more

impl<T> BorrowMut<T> for T
where T: ?Sized,

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more

impl<T> From<T> for T

fn from(t: T) -> T

Returns the argument unchanged.

impl<T, U> Into<U> for T
where U: From<T>,

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

impl<T, U> TryFrom<U> for T
where U: Into<T>,

type Error = Infallible

The type returned in the event of a conversion error.

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.