Struct Engine 

pub struct Engine<'rt> { /* private fields */ }

Represents a deserialized TensorRT engine borrowed from its parent runtime.

Implementations

impl Engine<'_>

pub fn as_raw(&self) -> trtICudaEngine_t

pub fn num_io_tensors(&self) -> Result<i32>

pub fn io_tensor_name(&self, index: i32) -> Result<String>

pub fn tensor_io_mode(&self, name: &str) -> Result<IoMode>

pub fn tensor_data_type(&self, name: &str) -> Result<DataType>

pub fn tensor_shape(&self, name: &str) -> Result<Dims>

pub fn create_execution_context(&self) -> Result<ExecutionContext<'_>>

pub fn create_execution_context_with_strategy( &self, strategy: AllocStrategy, ) -> Result<ExecutionContext<'_>>

Create an execution context with a user-chosen allocation strategy. Use AllocStrategy::UserManaged when you intend to supply a scratch-allocator yourself; AllocStrategy::Static preallocates the maximum workspace at context-creation time.

pub fn name(&self) -> Result<String>

Engine name as set in the TensorRT builder.

pub fn num_optimization_profiles(&self) -> Result<i32>

Number of optimization profiles that were baked into the engine.

pub fn serialize(&self) -> Result<HostMemory>

Serialize this engine back into a byte blob you can round-trip to disk. The returned HostMemory owns TensorRT-allocated storage; use HostMemory::as_slice to copy.

Trait Implementations

impl<'rt> Debug for Engine<'rt>

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Drop for Engine<'_>

fn drop(&mut self)

Executes the destructor for this type.

fn pin_drop(self: Pin<&mut Self>)

🔬This is a nightly-only experimental API. (pin_ergonomics)

Execute the destructor for this type, but different to Drop::drop, it requires self to be pinned.