Enum DynamicShapesKernelSpecializationStrategy 

#[repr(i32)]
pub enum DynamicShapesKernelSpecializationStrategy {
    kLAZY = 0,
    kEAGER = 1,
    kNONE = 2,
}

DynamicShapesKernelSpecializationStrategy

Different kernel specialization strategies for dynamic shapes.

Compilation behavior of dynamic shape kernels specialized for a new shape can be controlled at runtime. The user can either let the implementation compile a specialized kernel in the background, immediately or not choose to compile specialized kernels at all.

See [IRuntimeConfig]

Variants

kLAZY = 0

Strategy to compile shape-specialized kernels for new shapes in the background lazily. Until this kernel is compiled, a fallback kernel is used to run inference. Once the shape-specialized kernel is compiled, it is used for next inference.

kEAGER = 1

Strategy to compile shape-specialized kernels for new shapes eagerly in a blocking fashion. Kernels are immediately used for next inference.

kNONE = 2

Strategy to always use fallback kernels for inference, never compiling shape-specialized kernels.

Trait Implementations

impl Clone for DynamicShapesKernelSpecializationStrategy

fn clone(&self) -> DynamicShapesKernelSpecializationStrategy

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl ExternType for DynamicShapesKernelSpecializationStrategy

type Id = (n, v, i, n, f, e, r, _1, (), D, y, n, a, m, i, c, S, h, a, p, e, s, K, e, r, n, e, l, S, p, e, c, i, a, l, i, z, a, t, i, o, n, S, t, r, a, t, e, g, y)

A type-level representation of the type’s C++ namespace and type name.

type Kind = Trivial

Either cxx::kind::Opaque or cxx::kind::Trivial.

impl From<DynamicShapesKernelSpecializationStrategy> for DynamicShapesKernelSpecializationStrategy

fn from(value: DynamicShapesKernelSpecializationStrategy) -> Self

Converts to this type from the input type.

impl Hash for DynamicShapesKernelSpecializationStrategy

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl Into<DynamicShapesKernelSpecializationStrategy> for DynamicShapesKernelSpecializationStrategy

fn into(self) -> DynamicShapesKernelSpecializationStrategy

Converts this type into the (usually inferred) input type.

impl PartialEq for DynamicShapesKernelSpecializationStrategy

fn eq(&self, other: &DynamicShapesKernelSpecializationStrategy) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for DynamicShapesKernelSpecializationStrategy

impl SharedPtrTarget for DynamicShapesKernelSpecializationStrategy

impl StructuralPartialEq for DynamicShapesKernelSpecializationStrategy

impl UniquePtrTarget for DynamicShapesKernelSpecializationStrategy

impl VectorElement for DynamicShapesKernelSpecializationStrategy

impl WeakPtrTarget for DynamicShapesKernelSpecializationStrategy