Struct ServerEfficiency 

pub struct ServerEfficiency {
    pub throughput_samples_per_sec: f64,
    pub gpu_utilization_percent: f64,
    pub memory_bandwidth_gbps: f64,
}

Server deployment efficiency metrics

Fields

throughput_samples_per_sec: f64

Training/inference throughput in samples per second

gpu_utilization_percent: f64

GPU utilization percentage (0-100)

memory_bandwidth_gbps: f64

Memory bandwidth in GB/s

Implementations

impl ServerEfficiency

pub fn new( throughput_samples_per_sec: f64, gpu_utilization_percent: f64, memory_bandwidth_gbps: f64, ) -> Self

Create new server efficiency metrics

pub fn is_gpu_efficient(&self) -> bool

Check if GPU is being efficiently utilized (>70%)

pub fn is_gpu_underutilized(&self) -> bool

Check if GPU is underutilized (<50%)

pub fn throughput_efficiency(&self) -> f64

Calculate throughput efficiency (samples per second per % GPU util)

pub fn estimated_max_throughput(&self) -> f64

Estimate maximum throughput at 100% utilization

pub fn memory_bound(&self, expected_bandwidth_gbps: f64) -> bool

Check if memory bandwidth might be a bottleneck

Trait Implementations

impl Clone for ServerEfficiency

fn clone(&self) -> ServerEfficiency

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ServerEfficiency

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for ServerEfficiency

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for ServerEfficiency

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl PartialEq for ServerEfficiency

fn eq(&self, other: &ServerEfficiency) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for ServerEfficiency

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for ServerEfficiency