Struct InferenceMetrics

#[non_exhaustive]
pub struct InferenceMetrics {
    pub max_invocations: Option<i32>,
    pub model_latency: Option<i32>,
}

The metrics for an existing endpoint compared in an Inference Recommender job.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

max_invocations: Option<i32>

The expected maximum number of requests per minute for the instance.

model_latency: Option<i32>

The expected model latency at maximum invocations per minute for the instance.

Implementations

impl InferenceMetrics

pub fn max_invocations(&self) -> Option<i32>

The expected maximum number of requests per minute for the instance.

pub fn model_latency(&self) -> Option<i32>

The expected model latency at maximum invocations per minute for the instance.

impl InferenceMetrics

pub fn builder() -> InferenceMetricsBuilder

Creates a new builder-style object to manufacture InferenceMetrics.

Trait Implementations

impl Clone for InferenceMetrics

fn clone(&self) -> InferenceMetrics

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for InferenceMetrics

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for InferenceMetrics

fn eq(&self, other: &InferenceMetrics) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for InferenceMetrics