Struct async_tensorrt::ffi::builder_config::BuilderConfig
source · pub struct BuilderConfig(/* private fields */);
Expand description
Holds properties for configuring a builder to produce an engine.
Implementations§
source§impl BuilderConfig
impl BuilderConfig
sourcepub fn with_max_workspace_size(self, size: usize) -> Self
pub fn with_max_workspace_size(self, size: usize) -> Self
Set the maximum workspace size.
Arguments
size
- The maximum GPU temporary memory which the engine can use at execution time in bytes.
sourcepub fn with_strict_types(self) -> Self
pub fn with_strict_types(self) -> Self
Set the kSTRICT_TYPES
flag.
TensorRT documentation for setFlag
TensorRT documentation for kSTRICT_TYPES
sourcepub fn with_fp16(self) -> Self
pub fn with_fp16(self) -> Self
Set the kFP16
flag.
TensorRT documentation for setFlag
TensorRT documentation for kFP16
sourcepub fn with_optimization_profile(
self,
optimization_profile: OptimizationProfile<'_>
) -> Result<Self, Error>
pub fn with_optimization_profile( self, optimization_profile: OptimizationProfile<'_> ) -> Result<Self, Error>
Add an optimization profile.
sourcepub fn add_optimization_profile(
&mut self,
optimization_profile: OptimizationProfile<'_>
) -> Result<(), Error>
pub fn add_optimization_profile( &mut self, optimization_profile: OptimizationProfile<'_> ) -> Result<(), Error>
Add an optimization profile.
sourcepub fn as_mut_ptr(&mut self) -> *mut c_void
pub fn as_mut_ptr(&mut self) -> *mut c_void
Get internal mutable pointer.
Trait Implementations§
source§impl Drop for BuilderConfig
impl Drop for BuilderConfig
impl Send for BuilderConfig
Implements Send
for BuilderConfig
.
Safety
The TensorRT API is thread-safe with regards to all operations on BuilderConfig
.
impl Sync for BuilderConfig
Implements Sync
for BuilderConfig
.
Safety
The TensorRT API is thread-safe with regards to all operations on BuilderConfig
.
Auto Trait Implementations§
impl RefUnwindSafe for BuilderConfig
impl Unpin for BuilderConfig
impl UnwindSafe for BuilderConfig
Blanket Implementations§
source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more