Expand description
Safe wrapper around nvinfer1::ICudaEngine.
The C++ object is *mut sys::ICudaEngine; we wrap it in a newtype
that owns the pointer and is Send + Sync because the engine is
immutable post-build (multiple IExecutionContexts share it
safely). The Drop impl calls the FFI destroy shim under the
tensorrt-link feature; without the feature the pointer is always
null and Drop is a no-op (so unit tests construct engines without
libnvinfer).
Structs§
- Engine
Plan - Owned plan blob (serialised engine).
- TrtEngine
- Owned, immutable TensorRT engine.
- TrtRefitter
- Refit handle — holds an
IRefitter*for in-place engine weight updates.