Struct aws_sdk_sagemaker::types::builders::MultiModelConfigBuilder

#[non_exhaustive]
pub struct MultiModelConfigBuilder { /* private fields */ }

A builder for MultiModelConfig.

Implementations

impl MultiModelConfigBuilder

pub fn model_cache_setting(self, input: ModelCacheSetting) -> Self

Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter to Disabled.

pub fn set_model_cache_setting(self, input: Option<ModelCacheSetting>) -> Self

Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter to Disabled.

pub fn get_model_cache_setting(&self) -> &Option<ModelCacheSetting>

Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter to Disabled.

pub fn build(self) -> MultiModelConfig

Consumes the builder and constructs a MultiModelConfig.

Trait Implementations

impl Clone for MultiModelConfigBuilder

fn clone(&self) -> MultiModelConfigBuilder

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for MultiModelConfigBuilder

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for MultiModelConfigBuilder

fn default() -> MultiModelConfigBuilder

Returns the “default value” for a type.

impl PartialEq<MultiModelConfigBuilder> for MultiModelConfigBuilder

fn eq(&self, other: &MultiModelConfigBuilder) -> bool

This method tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

This method tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for MultiModelConfigBuilder