Struct GpuMemory 

pub struct GpuMemory {
    pub held_gb: f32,
    pub total_gb: f32,
}

Device memory held by the models the daemon keeps loaded.

Fields

held_gb: f32

Sum of the catalogue estimates of loaded (or loading) models, GB.

total_gb: f32

Device total, GB; 0 when unknown.

Implementations

impl GpuMemory

pub fn from_models(models: &[ModelEntry], total_gb: f32) -> Self

Memory the loaded models hold, from their catalogue estimates.

pub fn fraction(&self) -> f32

Share of the device held, 0..=1; 0 when the total is unknown.

pub fn label(&self) -> String

≈ 6.5 / 24 GB, or ≈ 6.5 GB when the total is unknown.

pub fn tone(&self) -> Tone

Trait Implementations

impl Clone for GpuMemory

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for GpuMemory

impl Debug for GpuMemory

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for GpuMemory

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for GpuMemory