#[non_exhaustive]pub struct AsyncInferenceClientConfig { /* private fields */ }
Expand description
Configures the behavior of the client used by SageMaker to interact with the model container during asynchronous inference.
Implementations§
source§impl AsyncInferenceClientConfig
impl AsyncInferenceClientConfig
sourcepub fn max_concurrent_invocations_per_instance(&self) -> Option<i32>
pub fn max_concurrent_invocations_per_instance(&self) -> Option<i32>
The maximum number of concurrent requests sent by the SageMaker client to the model container. If no value is provided, SageMaker chooses an optimal value.
source§impl AsyncInferenceClientConfig
impl AsyncInferenceClientConfig
sourcepub fn builder() -> Builder
pub fn builder() -> Builder
Creates a new builder-style object to manufacture AsyncInferenceClientConfig
.
Trait Implementations§
source§impl Clone for AsyncInferenceClientConfig
impl Clone for AsyncInferenceClientConfig
source§fn clone(&self) -> AsyncInferenceClientConfig
fn clone(&self) -> AsyncInferenceClientConfig
Returns a copy of the value. Read more
1.0.0 · source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source
. Read moresource§impl Debug for AsyncInferenceClientConfig
impl Debug for AsyncInferenceClientConfig
source§impl PartialEq<AsyncInferenceClientConfig> for AsyncInferenceClientConfig
impl PartialEq<AsyncInferenceClientConfig> for AsyncInferenceClientConfig
source§fn eq(&self, other: &AsyncInferenceClientConfig) -> bool
fn eq(&self, other: &AsyncInferenceClientConfig) -> bool
This method tests for
self
and other
values to be equal, and is used
by ==
.