Struct aws_sdk_sagemaker::operation::create_inference_component::builders::CreateInferenceComponentFluentBuilder

pub struct CreateInferenceComponentFluentBuilder { /* private fields */ }

Fluent builder constructing a request to CreateInferenceComponent.

Creates an inference component, which is a SageMaker hosting object that you can use to deploy a model to an endpoint. In the inference component settings, you specify the model, the endpoint, and how the model utilizes the resources that the endpoint hosts. You can optimize resource utilization by tailoring how the required CPU cores, accelerators, and memory are allocated. You can deploy multiple inference components to an endpoint, where each inference component contains one model and the resource utilization needs for that individual model. After you deploy an inference component, you can directly invoke the associated model when you use the InvokeEndpoint API action.

Implementations

impl CreateInferenceComponentFluentBuilder

pub fn as_input(&self) -> &CreateInferenceComponentInputBuilder

Access the CreateInferenceComponent as a reference.

pub async fn send( self, ) -> Result<CreateInferenceComponentOutput, SdkError<CreateInferenceComponentError, HttpResponse>>

Sends the request and returns the response.

If an error occurs, an SdkError will be returned with additional details that can be matched against.

By default, any retryable failures will be retried twice. Retry behavior is configurable with the RetryConfig, which can be set when configuring the client.

pub fn customize( self, ) -> CustomizableOperation<CreateInferenceComponentOutput, CreateInferenceComponentError, Self>

Consumes this builder, creating a customizable operation that can be modified before being sent.

pub fn inference_component_name(self, input: impl Into<String>) -> Self

A unique name to assign to the inference component.

pub fn set_inference_component_name(self, input: Option<String>) -> Self

A unique name to assign to the inference component.

pub fn get_inference_component_name(&self) -> &Option<String>

A unique name to assign to the inference component.

pub fn endpoint_name(self, input: impl Into<String>) -> Self

The name of an existing endpoint where you host the inference component.

pub fn set_endpoint_name(self, input: Option<String>) -> Self

The name of an existing endpoint where you host the inference component.

pub fn get_endpoint_name(&self) -> &Option<String>

The name of an existing endpoint where you host the inference component.

pub fn variant_name(self, input: impl Into<String>) -> Self

The name of an existing production variant where you host the inference component.

pub fn set_variant_name(self, input: Option<String>) -> Self

The name of an existing production variant where you host the inference component.

pub fn get_variant_name(&self) -> &Option<String>

The name of an existing production variant where you host the inference component.

pub fn specification(self, input: InferenceComponentSpecification) -> Self

Details about the resources to deploy with this inference component, including the model, container, and compute resources.

pub fn set_specification( self, input: Option<InferenceComponentSpecification>, ) -> Self

Details about the resources to deploy with this inference component, including the model, container, and compute resources.

pub fn get_specification(&self) -> &Option<InferenceComponentSpecification>

Details about the resources to deploy with this inference component, including the model, container, and compute resources.

pub fn runtime_config(self, input: InferenceComponentRuntimeConfig) -> Self

Runtime settings for a model that is deployed with an inference component.

pub fn set_runtime_config( self, input: Option<InferenceComponentRuntimeConfig>, ) -> Self

Runtime settings for a model that is deployed with an inference component.

pub fn get_runtime_config(&self) -> &Option<InferenceComponentRuntimeConfig>

Runtime settings for a model that is deployed with an inference component.

pub fn tags(self, input: Tag) -> Self

Appends an item to Tags.

To override the contents of this collection use set_tags.

A list of key-value pairs associated with the model. For more information, see Tagging Amazon Web Services resources in the Amazon Web Services General Reference.

pub fn set_tags(self, input: Option<Vec<Tag>>) -> Self

A list of key-value pairs associated with the model. For more information, see Tagging Amazon Web Services resources in the Amazon Web Services General Reference.

pub fn get_tags(&self) -> &Option<Vec<Tag>>

A list of key-value pairs associated with the model. For more information, see Tagging Amazon Web Services resources in the Amazon Web Services General Reference.

Trait Implementations

impl Clone for CreateInferenceComponentFluentBuilder

fn clone(&self) -> CreateInferenceComponentFluentBuilder

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CreateInferenceComponentFluentBuilder

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.