pub enum KernelInput<'a> {
Tensor(TensorView<'a>),
Weight(&'a WeightHandle),
}Expand description
An executor-delivered kernel input. Existing EPs receive Tensor variants;
an EP advertising the nxrt capability may receive a lazy Weight at the
pkg.nxrt::BlockQuantizedMoE boundary.
Variants§
Tensor(TensorView<'a>)
Weight(&'a WeightHandle)
Implementations§
Source§impl<'a> KernelInput<'a>
impl<'a> KernelInput<'a>
pub fn tensor(&self) -> Option<&TensorView<'a>>
pub fn weight(&self) -> Option<&WeightHandle>
Auto Trait Implementations§
impl<'a> !RefUnwindSafe for KernelInput<'a>
impl<'a> !Send for KernelInput<'a>
impl<'a> !Sync for KernelInput<'a>
impl<'a> !UnwindSafe for KernelInput<'a>
impl<'a> Freeze for KernelInput<'a>
impl<'a> Unpin for KernelInput<'a>
impl<'a> UnsafeUnpin for KernelInput<'a>
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more