Struct Tensor 

pub struct Tensor { /* private fields */ }

A device buffer with shape and element type: an input to or output from Context::invoke.

Implementations

impl Tensor

pub fn from_f32(device: &Device, shape: &[usize], data: &[f32]) -> Result<Self>

Allocate a device-local f32 buffer view, copying data in.

pub fn from_u8(device: &Device, shape: &[usize], data: &[u8]) -> Result<Self>

Allocate a device-local u8 buffer view, copying data in (e.g. an int8/uint8 quantized model input).

pub fn read_into_f32(&self, device: &Device, out: &mut [f32]) -> Result<()>

Copy the buffer contents back to the host as f32.

pub fn read_into_u8(&self, device: &Device, out: &mut [u8]) -> Result<()>

Copy the buffer contents back to the host as u8.

Trait Implementations

impl Drop for Tensor

fn drop(&mut self)

Executes the destructor for this type.

fn pin_drop(self: Pin<&mut Self>)

🔬This is a nightly-only experimental API. (pin_ergonomics)

Execute the destructor for this type, but different to Drop::drop, it requires self to be pinned.