Struct Runtime 

pub struct Runtime { /* private fields */ }

Allows a serialized engine to be serialized.

TensorRT documentation

Implementations

impl Runtime

pub async fn new() -> Self

Create a new Runtime.

pub async fn deserialize_engine_from_plan( self, plan: &HostBuffer, ) -> Result<Engine, Error>

Deserialize engine from a plan (a HostBuffer).

TensorRT documentation

Arguments

• plan - Plan to deserialize from.

pub async fn deserialize_engine(self, buffer: &[u8]) -> Result<Engine, Error>

Deserialize engine from a slice buffer.

TensorRT documentation

Arguments

• buffer - Buffer slice to read from.