Struct LlamaBackendDevice 

pub struct LlamaBackendDevice {
    pub index: usize,
    pub name: String,
    pub description: String,
    pub backend: String,
    pub memory_total: usize,
    pub memory_free: usize,
    pub device_type: LlamaBackendDeviceType,
}

A ggml backend device

The index is can be used from LlamaModelParams::with_devices to select specific devices.

Fields

index: usize

The index of the device

The index is can be used from LlamaModelParams::with_devices to select specific devices.

name: String

The name of the device (e.g. “Vulkan0”)

description: String

A description of the device (e.g. “NVIDIA GeForce RTX 3080”)

backend: String

The backend of the device (e.g. “Vulkan”, “CUDA”, “CPU”)

memory_total: usize

Total memory of the device in bytes

memory_free: usize

Free memory of the device in bytes

device_type: LlamaBackendDeviceType

Device type

Trait Implementations

impl Clone for LlamaBackendDevice

fn clone(&self) -> LlamaBackendDevice

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LlamaBackendDevice

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.