Struct ExecutionContext 

pub struct ExecutionContext<'e> { /* private fields */ }

Implementations

impl ExecutionContext<'_>

pub fn as_raw(&self) -> trtIExecutionContext_t

pub fn set_input_shape(&self, name: &str, dims: Dims) -> Result<()>

pub fn set_tensor_address(&self, name: &str, addr: *mut c_void) -> Result<()>

pub fn tensor_shape(&self, name: &str) -> Result<Dims>

pub fn tensor_address(&self, name: &str) -> Result<*mut c_void>

Read the current bound device address for a tensor (null if unset).

pub unsafe fn enqueue_v3(&self, stream: cudaStream_t) -> Result<()>

Enqueue the inference on the given CUDA stream. Returns Ok if TRT reports success; the stream is still responsible for ordering, and the caller must ensure all tensor addresses have been set.

Safety

stream must be a valid cudaStream_t that outlives the enqueue.

Trait Implementations

impl<'e> Debug for ExecutionContext<'e>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Drop for ExecutionContext<'_>

fn drop(&mut self)

Executes the destructor for this type.