Struct aws_sdk_sagemaker::model::AsyncInferenceClientConfig

#[non_exhaustive]
pub struct AsyncInferenceClientConfig {
    pub max_concurrent_invocations_per_instance: Option<i32>,
}

Configures the behavior of the client used by Amazon SageMaker to interact with the model container during asynchronous inference.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

max_concurrent_invocations_per_instance: Option<i32>

The maximum number of concurrent requests sent by the SageMaker client to the model container. If no value is provided, Amazon SageMaker will choose an optimal value for you.

Implementations

impl AsyncInferenceClientConfig

pub fn max_concurrent_invocations_per_instance(&self) -> Option<i32>

The maximum number of concurrent requests sent by the SageMaker client to the model container. If no value is provided, Amazon SageMaker will choose an optimal value for you.

impl AsyncInferenceClientConfig

pub fn builder() -> Builder

Creates a new builder-style object to manufacture AsyncInferenceClientConfig

Trait Implementations

impl Clone for AsyncInferenceClientConfig

fn clone(&self) -> AsyncInferenceClientConfig

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for AsyncInferenceClientConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq<AsyncInferenceClientConfig> for AsyncInferenceClientConfig

fn eq(&self, other: &AsyncInferenceClientConfig) -> bool

This method tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &AsyncInferenceClientConfig) -> bool

This method tests for !=.

impl StructuralPartialEq for AsyncInferenceClientConfig