Struct InferenceComponentRollingUpdatePolicyBuilder

#[non_exhaustive]
pub struct InferenceComponentRollingUpdatePolicyBuilder { /* private fields */ }

A builder for InferenceComponentRollingUpdatePolicy.

Implementations

impl InferenceComponentRollingUpdatePolicyBuilder

pub fn maximum_batch_size(self, input: InferenceComponentCapacitySize) -> Self

The batch size for each rolling step in the deployment process. For each step, SageMaker AI provisions capacity on the new endpoint fleet, routes traffic to that fleet, and terminates capacity on the old endpoint fleet. The value must be between 5% to 50% of the copy count of the inference component.

This field is required.

pub fn set_maximum_batch_size( self, input: Option<InferenceComponentCapacitySize>, ) -> Self

The batch size for each rolling step in the deployment process. For each step, SageMaker AI provisions capacity on the new endpoint fleet, routes traffic to that fleet, and terminates capacity on the old endpoint fleet. The value must be between 5% to 50% of the copy count of the inference component.

pub fn get_maximum_batch_size(&self) -> &Option<InferenceComponentCapacitySize>

The batch size for each rolling step in the deployment process. For each step, SageMaker AI provisions capacity on the new endpoint fleet, routes traffic to that fleet, and terminates capacity on the old endpoint fleet. The value must be between 5% to 50% of the copy count of the inference component.

pub fn wait_interval_in_seconds(self, input: i32) -> Self

The length of the baking period, during which SageMaker AI monitors alarms for each batch on the new fleet.

This field is required.

pub fn set_wait_interval_in_seconds(self, input: Option<i32>) -> Self

The length of the baking period, during which SageMaker AI monitors alarms for each batch on the new fleet.

pub fn get_wait_interval_in_seconds(&self) -> &Option<i32>

The length of the baking period, during which SageMaker AI monitors alarms for each batch on the new fleet.

pub fn maximum_execution_timeout_in_seconds(self, input: i32) -> Self

The time limit for the total deployment. Exceeding this limit causes a timeout.

pub fn set_maximum_execution_timeout_in_seconds( self, input: Option<i32>, ) -> Self

The time limit for the total deployment. Exceeding this limit causes a timeout.

pub fn get_maximum_execution_timeout_in_seconds(&self) -> &Option<i32>

The time limit for the total deployment. Exceeding this limit causes a timeout.

pub fn rollback_maximum_batch_size( self, input: InferenceComponentCapacitySize, ) -> Self

The batch size for a rollback to the old endpoint fleet. If this field is absent, the value is set to the default, which is 100% of the total capacity. When the default is used, SageMaker AI provisions the entire capacity of the old fleet at once during rollback.

pub fn set_rollback_maximum_batch_size( self, input: Option<InferenceComponentCapacitySize>, ) -> Self

The batch size for a rollback to the old endpoint fleet. If this field is absent, the value is set to the default, which is 100% of the total capacity. When the default is used, SageMaker AI provisions the entire capacity of the old fleet at once during rollback.

pub fn get_rollback_maximum_batch_size( &self, ) -> &Option<InferenceComponentCapacitySize>

The batch size for a rollback to the old endpoint fleet. If this field is absent, the value is set to the default, which is 100% of the total capacity. When the default is used, SageMaker AI provisions the entire capacity of the old fleet at once during rollback.

pub fn build(self) -> InferenceComponentRollingUpdatePolicy

Consumes the builder and constructs a InferenceComponentRollingUpdatePolicy.

Trait Implementations

impl Clone for InferenceComponentRollingUpdatePolicyBuilder

fn clone(&self) -> InferenceComponentRollingUpdatePolicyBuilder

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for InferenceComponentRollingUpdatePolicyBuilder

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for InferenceComponentRollingUpdatePolicyBuilder

fn default() -> InferenceComponentRollingUpdatePolicyBuilder

Returns the “default value” for a type.

impl PartialEq for InferenceComponentRollingUpdatePolicyBuilder

fn eq(&self, other: &InferenceComponentRollingUpdatePolicyBuilder) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for InferenceComponentRollingUpdatePolicyBuilder