Struct InferenceComponentDataCacheConfig 

#[non_exhaustive]
pub struct InferenceComponentDataCacheConfig {
    pub enable_caching: Option<bool>,
}

Settings that affect how the inference component caches data.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

enable_caching: Option<bool>

Sets whether the endpoint that hosts the inference component caches the model artifacts and container image.

With caching enabled, the endpoint caches this data in each instance that it provisions for the inference component. That way, the inference component deploys faster during the auto scaling process. If caching isn't enabled, the inference component takes longer to deploy because of the time it spends downloading the data.

Implementations

impl InferenceComponentDataCacheConfig

pub fn enable_caching(&self) -> Option<bool>

Sets whether the endpoint that hosts the inference component caches the model artifacts and container image.

With caching enabled, the endpoint caches this data in each instance that it provisions for the inference component. That way, the inference component deploys faster during the auto scaling process. If caching isn't enabled, the inference component takes longer to deploy because of the time it spends downloading the data.

impl InferenceComponentDataCacheConfig

pub fn builder() -> InferenceComponentDataCacheConfigBuilder

Creates a new builder-style object to manufacture InferenceComponentDataCacheConfig.

Trait Implementations

impl Clone for InferenceComponentDataCacheConfig

fn clone(&self) -> InferenceComponentDataCacheConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for InferenceComponentDataCacheConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for InferenceComponentDataCacheConfig

fn eq(&self, other: &InferenceComponentDataCacheConfig) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for InferenceComponentDataCacheConfig