Struct aws_sdk_sagemaker::types::AsyncInferenceClientConfig

#[non_exhaustive]
pub struct AsyncInferenceClientConfig {
    pub max_concurrent_invocations_per_instance: Option<i32>,
}

Configures the behavior of the client used by SageMaker to interact with the model container during asynchronous inference.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

max_concurrent_invocations_per_instance: Option<i32>

The maximum number of concurrent requests sent by the SageMaker client to the model container. If no value is provided, SageMaker chooses an optimal value.

Implementations

impl AsyncInferenceClientConfig

pub fn max_concurrent_invocations_per_instance(&self) -> Option<i32>

The maximum number of concurrent requests sent by the SageMaker client to the model container. If no value is provided, SageMaker chooses an optimal value.

impl AsyncInferenceClientConfig

pub fn builder() -> AsyncInferenceClientConfigBuilder

Creates a new builder-style object to manufacture AsyncInferenceClientConfig.

Trait Implementations

impl Clone for AsyncInferenceClientConfig

fn clone(&self) -> AsyncInferenceClientConfig

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for AsyncInferenceClientConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq<AsyncInferenceClientConfig> for AsyncInferenceClientConfig

fn eq(&self, other: &AsyncInferenceClientConfig) -> bool

This method tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

This method tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for AsyncInferenceClientConfig