Struct LlamaBackendDevice 

pub struct LlamaBackendDevice { /* private fields */ }

Opaque ggml backend device handle returned by LlamaModel::get_device.

Use Self::name, Self::description, Self::device_type, and Self::memory to inspect the device. The handle is valid for the lifetime of the parent LlamaModel.

Implementations

impl LlamaBackendDevice

pub fn name(&self) -> Result<&str, StringFromModelError>

Human-readable device name (e.g. CUDA0, Metal).

Errors

Returns an error when the name pointer is null or not valid UTF-8.

pub fn description(&self) -> Result<&str, StringFromModelError>

Longer device description (often includes hardware name).

Errors

Returns an error when the description pointer is null or not valid UTF-8.

pub fn device_type(&self) -> LlamaBackendDeviceType

Device class (CPU, GPU, integrated GPU, …).

pub fn memory(&self) -> (usize, usize)

Device memory (free_bytes, total_bytes).

Trait Implementations

impl Clone for LlamaBackendDevice

fn clone(&self) -> LlamaBackendDevice

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for LlamaBackendDevice

impl Debug for LlamaBackendDevice

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for LlamaBackendDevice

impl PartialEq for LlamaBackendDevice

fn eq(&self, other: &LlamaBackendDevice) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for LlamaBackendDevice