Struct InferenceComponentAvailabilityZoneBalance 

#[non_exhaustive]
pub struct InferenceComponentAvailabilityZoneBalance {
    pub enforcement_mode: Option<AvailabilityZoneBalanceEnforcementMode>,
    pub max_imbalance: Option<i32>,
}

Configuration for balancing inference component copies across Availability Zones.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

enforcement_mode: Option<AvailabilityZoneBalanceEnforcementMode>

Determines how strictly the Availability Zone balance constraint is enforced.

PERMISSIVE

The endpoint attempts to balance copies across Availability Zones but proceeds with scheduling even if balance can't be achieved due to available capacity or instance distribution across Availability Zones.

max_imbalance: Option<i32>

The maximum allowed difference in the number of inference component copies between any two Availability Zones. This parameter applies only when the endpoint has instances across two or more Availability Zones. A copy placement is allowed if it reduces imbalance or the resulting imbalance is within this value.

Default value: 0.

Implementations

impl InferenceComponentAvailabilityZoneBalance

pub fn enforcement_mode( &self, ) -> Option<&AvailabilityZoneBalanceEnforcementMode>

Determines how strictly the Availability Zone balance constraint is enforced.

PERMISSIVE

The endpoint attempts to balance copies across Availability Zones but proceeds with scheduling even if balance can't be achieved due to available capacity or instance distribution across Availability Zones.

pub fn max_imbalance(&self) -> Option<i32>

The maximum allowed difference in the number of inference component copies between any two Availability Zones. This parameter applies only when the endpoint has instances across two or more Availability Zones. A copy placement is allowed if it reduces imbalance or the resulting imbalance is within this value.

Default value: 0.

impl InferenceComponentAvailabilityZoneBalance

pub fn builder() -> InferenceComponentAvailabilityZoneBalanceBuilder

Creates a new builder-style object to manufacture InferenceComponentAvailabilityZoneBalance.

Trait Implementations

impl Clone for InferenceComponentAvailabilityZoneBalance

fn clone(&self) -> InferenceComponentAvailabilityZoneBalance

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for InferenceComponentAvailabilityZoneBalance

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for InferenceComponentAvailabilityZoneBalance

fn eq(&self, other: &InferenceComponentAvailabilityZoneBalance) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for InferenceComponentAvailabilityZoneBalance