pub struct Builder { /* private fields */ }
Expand description
A builder for CreateEndpointConfigInput
.
Implementations§
source§impl Builder
impl Builder
sourcepub fn endpoint_config_name(self, input: impl Into<String>) -> Self
pub fn endpoint_config_name(self, input: impl Into<String>) -> Self
The name of the endpoint configuration. You specify this name in a CreateEndpoint
request.
sourcepub fn set_endpoint_config_name(self, input: Option<String>) -> Self
pub fn set_endpoint_config_name(self, input: Option<String>) -> Self
The name of the endpoint configuration. You specify this name in a CreateEndpoint
request.
sourcepub fn production_variants(self, input: ProductionVariant) -> Self
pub fn production_variants(self, input: ProductionVariant) -> Self
Appends an item to production_variants
.
To override the contents of this collection use set_production_variants
.
An array of ProductionVariant
objects, one for each model that you want to host at this endpoint.
sourcepub fn set_production_variants(
self,
input: Option<Vec<ProductionVariant>>
) -> Self
pub fn set_production_variants(
self,
input: Option<Vec<ProductionVariant>>
) -> Self
An array of ProductionVariant
objects, one for each model that you want to host at this endpoint.
sourcepub fn data_capture_config(self, input: DataCaptureConfig) -> Self
pub fn data_capture_config(self, input: DataCaptureConfig) -> Self
Configuration to control how SageMaker captures inference data.
sourcepub fn set_data_capture_config(self, input: Option<DataCaptureConfig>) -> Self
pub fn set_data_capture_config(self, input: Option<DataCaptureConfig>) -> Self
Configuration to control how SageMaker captures inference data.
Appends an item to tags
.
To override the contents of this collection use set_tags
.
An array of key-value pairs. You can use tags to categorize your Amazon Web Services resources in different ways, for example, by purpose, owner, or environment. For more information, see Tagging Amazon Web Services Resources.
An array of key-value pairs. You can use tags to categorize your Amazon Web Services resources in different ways, for example, by purpose, owner, or environment. For more information, see Tagging Amazon Web Services Resources.
sourcepub fn kms_key_id(self, input: impl Into<String>) -> Self
pub fn kms_key_id(self, input: impl Into<String>) -> Self
The Amazon Resource Name (ARN) of a Amazon Web Services Key Management Service key that SageMaker uses to encrypt data on the storage volume attached to the ML compute instance that hosts the endpoint.
The KmsKeyId can be any of the following formats:
-
Key ID:
1234abcd-12ab-34cd-56ef-1234567890ab
-
Key ARN:
arn:aws:kms:us-west-2:111122223333:key/1234abcd-12ab-34cd-56ef-1234567890ab
-
Alias name:
alias/ExampleAlias
-
Alias name ARN:
arn:aws:kms:us-west-2:111122223333:alias/ExampleAlias
The KMS key policy must grant permission to the IAM role that you specify in your CreateEndpoint
, UpdateEndpoint
requests. For more information, refer to the Amazon Web Services Key Management Service section Using Key Policies in Amazon Web Services KMS
Certain Nitro-based instances include local storage, dependent on the instance type. Local storage volumes are encrypted using a hardware module on the instance. You can't request a KmsKeyId
when using an instance type with local storage. If any of the models that you specify in the ProductionVariants
parameter use nitro-based instances with local storage, do not specify a value for the KmsKeyId
parameter. If you specify a value for KmsKeyId
when using any nitro-based instances with local storage, the call to CreateEndpointConfig
fails.
For a list of instance types that support local instance storage, see Instance Store Volumes.
For more information about local instance storage encryption, see SSD Instance Store Volumes.
sourcepub fn set_kms_key_id(self, input: Option<String>) -> Self
pub fn set_kms_key_id(self, input: Option<String>) -> Self
The Amazon Resource Name (ARN) of a Amazon Web Services Key Management Service key that SageMaker uses to encrypt data on the storage volume attached to the ML compute instance that hosts the endpoint.
The KmsKeyId can be any of the following formats:
-
Key ID:
1234abcd-12ab-34cd-56ef-1234567890ab
-
Key ARN:
arn:aws:kms:us-west-2:111122223333:key/1234abcd-12ab-34cd-56ef-1234567890ab
-
Alias name:
alias/ExampleAlias
-
Alias name ARN:
arn:aws:kms:us-west-2:111122223333:alias/ExampleAlias
The KMS key policy must grant permission to the IAM role that you specify in your CreateEndpoint
, UpdateEndpoint
requests. For more information, refer to the Amazon Web Services Key Management Service section Using Key Policies in Amazon Web Services KMS
Certain Nitro-based instances include local storage, dependent on the instance type. Local storage volumes are encrypted using a hardware module on the instance. You can't request a KmsKeyId
when using an instance type with local storage. If any of the models that you specify in the ProductionVariants
parameter use nitro-based instances with local storage, do not specify a value for the KmsKeyId
parameter. If you specify a value for KmsKeyId
when using any nitro-based instances with local storage, the call to CreateEndpointConfig
fails.
For a list of instance types that support local instance storage, see Instance Store Volumes.
For more information about local instance storage encryption, see SSD Instance Store Volumes.
sourcepub fn async_inference_config(self, input: AsyncInferenceConfig) -> Self
pub fn async_inference_config(self, input: AsyncInferenceConfig) -> Self
Specifies configuration for how an endpoint performs asynchronous inference. This is a required field in order for your Endpoint to be invoked using InvokeEndpointAsync.
sourcepub fn set_async_inference_config(
self,
input: Option<AsyncInferenceConfig>
) -> Self
pub fn set_async_inference_config(
self,
input: Option<AsyncInferenceConfig>
) -> Self
Specifies configuration for how an endpoint performs asynchronous inference. This is a required field in order for your Endpoint to be invoked using InvokeEndpointAsync.
sourcepub fn explainer_config(self, input: ExplainerConfig) -> Self
pub fn explainer_config(self, input: ExplainerConfig) -> Self
A member of CreateEndpointConfig
that enables explainers.
sourcepub fn set_explainer_config(self, input: Option<ExplainerConfig>) -> Self
pub fn set_explainer_config(self, input: Option<ExplainerConfig>) -> Self
A member of CreateEndpointConfig
that enables explainers.
sourcepub fn shadow_production_variants(self, input: ProductionVariant) -> Self
pub fn shadow_production_variants(self, input: ProductionVariant) -> Self
Appends an item to shadow_production_variants
.
To override the contents of this collection use set_shadow_production_variants
.
An array of ProductionVariant
objects, one for each model that you want to host at this endpoint in shadow mode with production traffic replicated from the model specified on ProductionVariants
. If you use this field, you can only specify one variant for ProductionVariants
and one variant for ShadowProductionVariants
.
sourcepub fn set_shadow_production_variants(
self,
input: Option<Vec<ProductionVariant>>
) -> Self
pub fn set_shadow_production_variants(
self,
input: Option<Vec<ProductionVariant>>
) -> Self
An array of ProductionVariant
objects, one for each model that you want to host at this endpoint in shadow mode with production traffic replicated from the model specified on ProductionVariants
. If you use this field, you can only specify one variant for ProductionVariants
and one variant for ShadowProductionVariants
.
sourcepub fn build(self) -> Result<CreateEndpointConfigInput, BuildError>
pub fn build(self) -> Result<CreateEndpointConfigInput, BuildError>
Consumes the builder and constructs a CreateEndpointConfigInput
.