pub struct IOptimizationProfile { /* private fields */ }Expand description
! ! \class IOptimizationProfile ! \brief Optimization profile for dynamic input dimensions and shape tensors. ! ! When building an ICudaEngine from an INetworkDefinition that has dynamically resizable inputs (at least ! one input tensor has one or more of its dimensions specified as -1) or shape input tensors, users need to specify ! at least one optimization profile. Optimization profiles are numbered 0, 1, … ! The first optimization profile that has been defined (with index 0) will be used by the ICudaEngine whenever no ! optimization profile has been selected explicitly. If none of the inputs are dynamic, the default optimization ! profile will be generated automatically unless it is explicitly provided by the user (this is possible but not ! required in this case). If more than a single optimization profile is defined, users may set a target how ! much additional weight space should be maximally allocated to each additional profile (as a fraction of the ! maximum, unconstrained memory). ! ! Users set optimum input tensor dimensions, as well as minimum and maximum input tensor dimensions. The builder ! selects the kernels that result in the lowest runtime for the optimum input tensor dimensions, and are valid for ! all input tensor sizes in the valid range between minimum and maximum dimensions. A runtime error will be raised ! if the input tensor dimensions fall outside the valid range for this profile. Likewise, users provide minimum, ! optimum, and maximum values for all shape tensor input values. ! ! \see IBuilderConfig::addOptimizationProfile() !