Enum InstanceGroupKind 

#[repr(u32)]
pub enum InstanceGroupKind {
    Auto = 0,
    Cpu = 1,
    Gpu = 2,
    Model = 3,
}

Kinds of instance groups recognized by TRITONSERVER

Variants

Auto = 0

This instance group represents instances that can run on either CPU or GPU. If all GPUs listed in ‘gpus’ are available then instances will be created on GPU(s), otherwise instances will be created on CPU.

Cpu = 1

This instance group represents instances that must run on the CPU.

Gpu = 2

This instance group represents instances that must run on the GPU.

Model = 3

This instance group represents instances that should run on the CPU and/or GPU(s) as specified by the model or backend itself. The inference server will not override the model/backend settings.

Trait Implementations

impl Clone for InstanceGroupKind

fn clone(&self) -> InstanceGroupKind

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for InstanceGroupKind

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Hash for InstanceGroupKind

fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

fn hash_slice<H>(data: &[Self], state: &mut H)

where H: Hasher, Self: Sized,

Feeds a slice of this type into the given Hasher.

impl PartialEq for InstanceGroupKind

fn eq(&self, other: &InstanceGroupKind) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Copy for InstanceGroupKind

impl Eq for InstanceGroupKind

impl StructuralPartialEq for InstanceGroupKind