Struct ScalingPolicyMetric

#[non_exhaustive]
pub struct ScalingPolicyMetric {
    pub invocations_per_instance: Option<i32>,
    pub model_latency: Option<i32>,
}

The metric for a scaling policy.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

invocations_per_instance: Option<i32>

The number of invocations sent to a model, normalized by InstanceCount in each ProductionVariant. 1/numberOfInstances is sent as the value on each request, where numberOfInstances is the number of active instances for the ProductionVariant behind the endpoint at the time of the request.

model_latency: Option<i32>

The interval of time taken by a model to respond as viewed from SageMaker. This interval includes the local communication times taken to send the request and to fetch the response from the container of a model and the time taken to complete the inference in the container.

Implementations

impl ScalingPolicyMetric

pub fn invocations_per_instance(&self) -> Option<i32>

The number of invocations sent to a model, normalized by InstanceCount in each ProductionVariant. 1/numberOfInstances is sent as the value on each request, where numberOfInstances is the number of active instances for the ProductionVariant behind the endpoint at the time of the request.

pub fn model_latency(&self) -> Option<i32>

The interval of time taken by a model to respond as viewed from SageMaker. This interval includes the local communication times taken to send the request and to fetch the response from the container of a model and the time taken to complete the inference in the container.

impl ScalingPolicyMetric

pub fn builder() -> ScalingPolicyMetricBuilder

Creates a new builder-style object to manufacture ScalingPolicyMetric.

Trait Implementations

impl Clone for ScalingPolicyMetric

fn clone(&self) -> ScalingPolicyMetric

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ScalingPolicyMetric

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for ScalingPolicyMetric

fn eq(&self, other: &ScalingPolicyMetric) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for ScalingPolicyMetric