Struct InferenceComponentComputeResourceRequirements

#[non_exhaustive]
pub struct InferenceComponentComputeResourceRequirements {
    pub number_of_cpu_cores_required: Option<f32>,
    pub number_of_accelerator_devices_required: Option<f32>,
    pub min_memory_required_in_mb: Option<i32>,
    pub max_memory_required_in_mb: Option<i32>,
}

Defines the compute resources to allocate to run a model, plus any adapter models, that you assign to an inference component. These resources include CPU cores, accelerators, and memory.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

number_of_cpu_cores_required: Option<f32>

The number of CPU cores to allocate to run a model that you assign to an inference component.

number_of_accelerator_devices_required: Option<f32>

The number of accelerators to allocate to run a model that you assign to an inference component. Accelerators include GPUs and Amazon Web Services Inferentia.

min_memory_required_in_mb: Option<i32>

The minimum MB of memory to allocate to run a model that you assign to an inference component.

max_memory_required_in_mb: Option<i32>

The maximum MB of memory to allocate to run a model that you assign to an inference component.

Implementations

impl InferenceComponentComputeResourceRequirements

pub fn number_of_cpu_cores_required(&self) -> Option<f32>

The number of CPU cores to allocate to run a model that you assign to an inference component.

pub fn number_of_accelerator_devices_required(&self) -> Option<f32>

The number of accelerators to allocate to run a model that you assign to an inference component. Accelerators include GPUs and Amazon Web Services Inferentia.

pub fn min_memory_required_in_mb(&self) -> Option<i32>

The minimum MB of memory to allocate to run a model that you assign to an inference component.

pub fn max_memory_required_in_mb(&self) -> Option<i32>

The maximum MB of memory to allocate to run a model that you assign to an inference component.

impl InferenceComponentComputeResourceRequirements

pub fn builder() -> InferenceComponentComputeResourceRequirementsBuilder

Creates a new builder-style object to manufacture InferenceComponentComputeResourceRequirements.

Trait Implementations

impl Clone for InferenceComponentComputeResourceRequirements

fn clone(&self) -> InferenceComponentComputeResourceRequirements

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for InferenceComponentComputeResourceRequirements

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for InferenceComponentComputeResourceRequirements

fn eq(&self, other: &InferenceComponentComputeResourceRequirements) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for InferenceComponentComputeResourceRequirements