Skip to main content

Module builder

Module builder 

Source
Expand description

Safe wrappers for nvinfer1::IBuilder and nvinfer1::IBuilderConfig.

Construction is GPU-free and panics-free even when libnvinfer is not installed: the IBuilderConfig struct is a pure-Rust value that records the requested knobs and is later replayed against the C++ builder via the FFI shim under tensorrt-link.

Structs§

BuilderFlags
Mirror of nvinfer1::BuilderFlag as a bitfield. Each flag toggles a single TensorRT optimisation knob; combine with |.
IBuilderConfig
Pure-Rust mirror of nvinfer1::IBuilderConfig. Holds the requested knobs in a side table; the FFI shim under tensorrt-link replays them against the C++ object inside BuilderActor::build.
TacticSources
Tactic sources to enable (mirrors nvinfer1::TacticSource).

Enums§

DeviceType
Default GPU/DLA target. DLA is the Jetson AI accelerator; Dla(core) selects a specific DLA core.
Precision
High-level inference precision policy. Maps to a combination of BuilderFlags (e.g. BEST ⇒ FP16 | INT8 | TF32 | BF16 | FP8).
RefitPolicy
Engine refit policy. OnDemand opts into BuilderFlags::REFIT, WeightsStreaming further enables STRIP_PLAN so weights live outside the engine plan.