Struct DeviceIoBinding 

pub struct DeviceIoBinding {
    pub dtype: DataType,
    /* private fields */
}

An externally owned persistent device allocation bound to a graph input and optionally aliased by a graph output.

Fields

dtype: DataType

Implementations

impl DeviceIoBinding

pub fn input_name(&self) -> &str

pub fn output_name(&self) -> Option<&str>

pub fn physical_shape(&self) -> &[usize]

pub fn logical_shape(&self) -> &[usize]

pub fn has_dynamic_logical_input_shape(&self) -> bool

Whether kernels see a logical prefix whose shape can differ from capacity.

pub fn exposes_logical_input_shape(&self) -> bool

Whether this input binding is configured to expose its logical prefix (valid length) to kernels rather than the padded physical capacity. Unlike Self::has_dynamic_logical_input_shape, this is a static property of the binding (fixed at allocation from the consumer-scoped capacity policy) and does not depend on the current logical shape. Callers that freeze a growing input to physical capacity for CUDA-graph eligibility must consult this: a binding that exposes its logical prefix cannot be frozen, because at least one consumer requires the valid length rather than the padded capacity (e.g. GLM-5.2’s indexer arithmetic branch).

pub fn set_logical_shape( &mut self, shape: Vec<usize>, ) -> Result<(), SessionError>

pub fn device_ptr(&self) -> *const c_void

pub fn transfer_stats(&self) -> DeviceBindingTransferStats

pub fn write_bytes( &mut self, byte_offset: usize, bytes: &[u8], ) -> Result<(), SessionError>

pub fn read_bytes(&mut self) -> Result<Vec<u8>, SessionError>

pub fn read_bytes_into(&mut self, bytes: &mut [u8]) -> Result<(), SessionError>

pub fn device_argmax_supported(&self) -> bool

pub fn device_argmax( &self, elements: usize, result: &mut DeviceIoBinding, ) -> Result<(), SessionError>

Trait Implementations

impl Debug for DeviceIoBinding

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Drop for DeviceIoBinding

fn drop(&mut self)

Executes the destructor for this type.

fn pin_drop(self: Pin<&mut Self>)

🔬This is a nightly-only experimental API. (pin_ergonomics)

Execute the destructor for this type, but different to Drop::drop, it requires self to be pinned.