Expand description
Safe-ish TensorRT runtime-side bindings.
Scope is inference only: load a serialized engine (e.g. produced by
trtexec or the TRT Python API), build an execution context, bind tensor
addresses, and enqueue execution on a CUDA stream. Engine construction
(the builder / network definition API) is C++-only and is not wrapped here.
Structs§
- Dims
- A dimension list up to 8 axes.
- Engine
- Represents a deserialized TensorRT engine borrowed from its parent runtime.
- Execution
Context - Host
Memory - TensorRT-owned host buffer (as returned by
Engine::serialize). - Runtime
- Owned TensorRT runtime. Created around a user-supplied logger (the logger pointer is passed verbatim; safety responsibility is on the caller).
Enums§
Functions§
- version
- TensorRT library version, encoded as
MAJOR * 1000 + MINOR * 100 + PATCH.