Struct aws_sdk_sagemaker::model::multi_model_config::Builder
source · [−]pub struct Builder { /* private fields */ }Expand description
A builder for MultiModelConfig.
Implementations
sourceimpl Builder
impl Builder
sourcepub fn model_cache_setting(self, input: ModelCacheSetting) -> Self
pub fn model_cache_setting(self, input: ModelCacheSetting) -> Self
Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter to Disabled.
sourcepub fn set_model_cache_setting(self, input: Option<ModelCacheSetting>) -> Self
pub fn set_model_cache_setting(self, input: Option<ModelCacheSetting>) -> Self
Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter to Disabled.
sourcepub fn build(self) -> MultiModelConfig
pub fn build(self) -> MultiModelConfig
Consumes the builder and constructs a MultiModelConfig.