Struct aws_sdk_sagemaker::model::multi_model_config::Builder [−][src]
#[non_exhaustive]pub struct Builder { /* fields omitted */ }
Expand description
A builder for MultiModelConfig
Implementations
Whether to cache models for a multi-model endpoint. By default, multi-model endpoints
cache models so that a model does not have to be loaded into memory each time it is
invoked. Some use cases do not benefit from model caching. For example, if an endpoint
hosts a large number of models that are each invoked infrequently, the endpoint might
perform better if you disable model caching. To disable model caching, set the value of
this parameter to Disabled
.
Whether to cache models for a multi-model endpoint. By default, multi-model endpoints
cache models so that a model does not have to be loaded into memory each time it is
invoked. Some use cases do not benefit from model caching. For example, if an endpoint
hosts a large number of models that are each invoked infrequently, the endpoint might
perform better if you disable model caching. To disable model caching, set the value of
this parameter to Disabled
.
Consumes the builder and constructs a MultiModelConfig
Trait Implementations
Auto Trait Implementations
impl RefUnwindSafe for Builder
impl UnwindSafe for Builder
Blanket Implementations
Mutably borrows from an owned value. Read more
Attaches the provided Subscriber
to this type, returning a
WithDispatch
wrapper. Read more
Attaches the current default Subscriber
to this type, returning a
WithDispatch
wrapper. Read more