Struct async_tensorrt::engine::Engine

pub struct Engine { /* private fields */ }

Engine for executing inference on a built network.

TensorRT documentation

Implementations

impl Engine

pub fn from_inner(inner: InnerEngine) -> Self

Create Engine from its inner object.

pub fn serialize(&self) -> Result<HostBuffer, Error>

Serialize the network.

TensorRT documentation

Return value

A HostBuffer that contains the serialized engine.

pub fn num_io_tensors(&self) -> usize

Get the number of IO tensors.

TensorRT documentation

pub fn io_tensor_name(&self, io_tensor_index: usize) -> String

Retrieve the name of an IO tensor.

TensorRT documentation

Arguments

• io_tensor_index - IO tensor index.

pub fn tensor_shape(&self, tensor_name: &str) -> Vec<usize>

Get the shape of a tensor.

TensorRT documentation

Arguments

• tensor_name - Tensor name.

pub fn tensor_io_mode(&self, tensor_name: &str) -> TensorIoMode

Get the IO mode of a tensor.

TensorRT documentation

Arguments

• tensor_name - Tensor name.