Struct DeviceView 

pub struct DeviceView { /* private fields */ }

A window into a device buffer owned by someone else, described by shape, strides and a byte offset.

The buffer is kept alive by the Arc, but its contents are not: the turn arena hands out windows at offsets the memory schema deliberately reuses, and a state-owned buffer is written by the op that owns it. So a view is good for the turn that produced it and no longer – it is read by the nodes downstream of its producer, and copied out at the model boundary rather than handed to the application.

Implementations

impl DeviceView

pub fn shape(&self) -> &[usize]

pub fn datum_type(&self) -> DatumType

Get the datum type of the tensor.

pub fn strides(&self) -> &[isize]

pub fn device_buffer(&self) -> &dyn DeviceBuffer

Get underlying inner device buffer.

pub fn device_buffer_ptr(&self) -> *const c_void

pub fn buffer_offset<I: Copy + 'static>(&self) -> I

where usize: AsPrimitive<I>,

Get underlying inner device buffer offset

pub fn exotic_fact(&self) -> Option<&dyn ExoticFact>

pub fn len(&self) -> usize

Get the number of values in the tensor.

pub fn as_bytes(&self) -> Vec<u8>

pub fn reshaped(&self, shape: impl Into<TVec<usize>>) -> TractResult<Self>

Reshaped tensor with given shape.

pub fn restrided(&self, strides: impl Into<TVec<isize>>) -> TractResult<Self>

pub fn is_packed(&self) -> bool

True where the bytes of this view are the tensor, in order and with no gap: what a reader working from a pointer and a length may assume.

pub fn to_host(&self) -> TractResult<Tensor>

Trait Implementations

impl Clone for DeviceView

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for DeviceView

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for DeviceView

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for DeviceView

impl From<DeviceView> for DeviceTensor

fn from(view: DeviceView) -> Self

Converts to this type from the input type.

impl Hash for DeviceView

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for DeviceView

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for DeviceView