Enum Device 

pub enum Device {
    Auto,
    Cpu {
        threads: usize,
    },
    Cuda(usize),
    Metal,
    Ane,
}

Where the model runs.

Variants

Auto

The first CUDA GPU when there is one and this build has CUDA, the CPU otherwise.

Cpu

The CPU, on threads threads, or every core for 0.

Fields

threads: usize

Worker threads.

Cuda(usize)

A CUDA GPU by ordinal.

Metal

The Apple GPU. Arrives with M4.

Ane

The Apple Neural Engine. Arrives with M4.

Trait Implementations

impl Clone for Device

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for Device

impl Debug for Device

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for Device

fn default() -> Self

Returns the “default value” for a type.

impl Eq for Device

impl PartialEq for Device

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for Device