Skip to main content

Module tensorrt_runtime

offline_intelligence::model_runtime

Module tensorrt_runtime 

Source
Expand description

TensorRT Runtime Adapter

Adapter for TensorRT optimized models (NVIDIA). Requires NVIDIA GPU and TensorRT runtime.

Structsยง

TensorRTRuntime