Expand description
Safe wrappers for nvinfer1::IBuilder and
nvinfer1::IBuilderConfig.
Construction is GPU-free and panics-free even when libnvinfer is
not installed: the IBuilderConfig struct is a pure-Rust value
that records the requested knobs and is later replayed against the
C++ builder via the FFI shim under tensorrt-link.
Structs§
- Builder
Flags - Mirror of
nvinfer1::BuilderFlagas a bitfield. Each flag toggles a single TensorRT optimisation knob; combine with|. - IBuilder
Config - Pure-Rust mirror of
nvinfer1::IBuilderConfig. Holds the requested knobs in a side table; the FFI shim undertensorrt-linkreplays them against the C++ object insideBuilderActor::build. - Tactic
Sources - Tactic sources to enable (mirrors
nvinfer1::TacticSource).
Enums§
- Device
Type - Default GPU/DLA target. DLA is the Jetson AI accelerator;
Dla(core)selects a specific DLA core. - Precision
- High-level inference precision policy. Maps to a combination of
BuilderFlags(e.g.BEST⇒ FP16 | INT8 | TF32 | BF16 | FP8). - Refit
Policy - Engine refit policy.
OnDemandopts intoBuilderFlags::REFIT,WeightsStreamingfurther enablesSTRIP_PLANso weights live outside the engine plan.