Skip to main content

F16Scratch

memra_engine::f16_ffi

Struct F16Scratch

pub struct F16Scratch {
    pub xh: CudaSlice<u8>,
    pub ws: CudaSlice<u8>,
    /* private fields */
}

Expand description

Resident scratch (fp8_ffi::Fp8Scratch pattern): fp16 activation (grown to the largest m*k seen) + the cuBLASLt workspace. Single GPU worker; the Mutex guards lazy build/grow only.

Fields§

§xh: CudaSlice<u8>§ws: CudaSlice<u8>

Implementations§

impl F16Scratch

pub fn with_capacity( e: &Engine, xh_bytes: usize, ) -> Result<Self, Box<dyn Error>>

Pre-sized scratch (task #14: the captured prime gets a PRIVATE scratch so the graph’s baked cvt/Lt pointers are never mutated by eager GEMMs between replays).

Auto Trait Implementations§

impl Freeze for F16Scratch

impl RefUnwindSafe for F16Scratch

impl Send for F16Scratch

impl Sync for F16Scratch

impl Unpin for F16Scratch

impl UnsafeUnpin for F16Scratch

impl UnwindSafe for F16Scratch

Blanket Implementations§

impl<T> Any for T
where T: 'static + ?Sized,

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more

impl<T> Borrow<T> for T
where T: ?Sized,

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more

impl<T> BorrowMut<T> for T
where T: ?Sized,

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more

impl<T> From<T> for T

fn from(t: T) -> T

Returns the argument unchanged.

impl<T, U> Into<U> for T
where U: From<T>,

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

impl<T, U> TryFrom<U> for T
where U: Into<T>,

type Error = Infallible

The type returned in the event of a conversion error.

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.