Enum CudaGraphStrategy 

#[repr(i32)]
pub enum CudaGraphStrategy {
    kDISABLED = 0,
    kWHOLE_GRAPH_CAPTURE = 1,
}

CudaGraphStrategy

Strategies available for CUDA graphs optimizations for JIT (Just-In-Time) inference.

See [IRuntimeConfig::setCudaGraphStrategy()], IRuntimeConfig::getCudaGraphStrategy()

Variants

kDISABLED = 0

Do not use CUDA graphs optimizations for inference.

kWHOLE_GRAPH_CAPTURE = 1

Capture CUDA graphs for the entire model execution as a single graph. This strategy captures the complete computational graph of the model and executes it atomically on the GPU stream. For dynamic shapes inference, this strategy captures the CUDA graph after the shape-specialized kernels are compiled for a given shape.

Trait Implementations

impl Clone for CudaGraphStrategy

fn clone(&self) -> CudaGraphStrategy

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl ExternType for CudaGraphStrategy

type Id = (n, v, i, n, f, e, r, _1, (), C, u, d, a, G, r, a, p, h, S, t, r, a, t, e, g, y)

A type-level representation of the type’s C++ namespace and type name.

type Kind = Trivial

Either cxx::kind::Opaque or cxx::kind::Trivial.

impl From<CudaGraphStrategy> for CudaGraphStrategy

fn from(value: CudaGraphStrategy) -> Self

Converts to this type from the input type.

impl Hash for CudaGraphStrategy

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl Into<CudaGraphStrategy> for CudaGraphStrategy

fn into(self) -> CudaGraphStrategy

Converts this type into the (usually inferred) input type.

impl PartialEq for CudaGraphStrategy

fn eq(&self, other: &CudaGraphStrategy) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for CudaGraphStrategy

impl SharedPtrTarget for CudaGraphStrategy

impl StructuralPartialEq for CudaGraphStrategy

impl UniquePtrTarget for CudaGraphStrategy

impl VectorElement for CudaGraphStrategy

impl WeakPtrTarget for CudaGraphStrategy