Enum aws_sdk_sagemaker::model::TrainingInputMode
source · [−]#[non_exhaustive]
pub enum TrainingInputMode {
Fastfile,
File,
Pipe,
Unknown(String),
}
Expand description
The training input mode that the algorithm supports. For more information about input modes, see Algorithms.
Pipe mode
If an algorithm supports Pipe
mode, Amazon SageMaker streams data directly
from Amazon S3 to the container.
File mode
If an algorithm supports File
mode, SageMaker
downloads the training data from S3 to the provisioned ML storage volume, and mounts the
directory to the Docker volume for the training container.
You must provision the ML storage volume with sufficient capacity to accommodate the data downloaded from S3. In addition to the training data, the ML storage volume also stores the output model. The algorithm container uses the ML storage volume to also store intermediate information, if any.
For distributed algorithms, training data is distributed uniformly. Your training duration is predictable if the input data objects sizes are approximately the same. SageMaker does not split the files any further for model training. If the object sizes are skewed, training won't be optimal as the data distribution is also skewed when one host in a training cluster is overloaded, thus becoming a bottleneck in training.
FastFile mode
If an algorithm supports FastFile
mode, SageMaker streams data directly
from S3 to the container with no code changes, and provides file system access to
the data. Users can author their training script to interact with these files as if
they were stored on disk.
FastFile
mode works best when the data is read sequentially.
Augmented manifest files aren't supported.
The startup time is lower when there are fewer files in the S3 bucket provided.
Variants (Non-exhaustive)
This enum is marked as non-exhaustive
Fastfile
File
Pipe
Unknown(String)
Unknown contains new variants that have been added since this code was generated.
Implementations
Trait Implementations
sourceimpl Clone for TrainingInputMode
impl Clone for TrainingInputMode
sourcefn clone(&self) -> TrainingInputMode
fn clone(&self) -> TrainingInputMode
Returns a copy of the value. Read more
1.0.0 · sourcefn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from source
. Read more
sourceimpl Debug for TrainingInputMode
impl Debug for TrainingInputMode
sourceimpl From<&'_ str> for TrainingInputMode
impl From<&'_ str> for TrainingInputMode
sourceimpl FromStr for TrainingInputMode
impl FromStr for TrainingInputMode
sourceimpl Hash for TrainingInputMode
impl Hash for TrainingInputMode
sourceimpl Ord for TrainingInputMode
impl Ord for TrainingInputMode
sourceimpl PartialEq<TrainingInputMode> for TrainingInputMode
impl PartialEq<TrainingInputMode> for TrainingInputMode
sourcefn eq(&self, other: &TrainingInputMode) -> bool
fn eq(&self, other: &TrainingInputMode) -> bool
This method tests for self
and other
values to be equal, and is used
by ==
. Read more
sourcefn ne(&self, other: &TrainingInputMode) -> bool
fn ne(&self, other: &TrainingInputMode) -> bool
This method tests for !=
.
sourceimpl PartialOrd<TrainingInputMode> for TrainingInputMode
impl PartialOrd<TrainingInputMode> for TrainingInputMode
sourcefn partial_cmp(&self, other: &TrainingInputMode) -> Option<Ordering>
fn partial_cmp(&self, other: &TrainingInputMode) -> Option<Ordering>
This method returns an ordering between self
and other
values if one exists. Read more
1.0.0 · sourcefn lt(&self, other: &Rhs) -> bool
fn lt(&self, other: &Rhs) -> bool
This method tests less than (for self
and other
) and is used by the <
operator. Read more
1.0.0 · sourcefn le(&self, other: &Rhs) -> bool
fn le(&self, other: &Rhs) -> bool
This method tests less than or equal to (for self
and other
) and is used by the <=
operator. Read more
impl Eq for TrainingInputMode
impl StructuralEq for TrainingInputMode
impl StructuralPartialEq for TrainingInputMode
Auto Trait Implementations
impl RefUnwindSafe for TrainingInputMode
impl Send for TrainingInputMode
impl Sync for TrainingInputMode
impl Unpin for TrainingInputMode
impl UnwindSafe for TrainingInputMode
Blanket Implementations
sourceimpl<T> BorrowMut<T> for T where
T: ?Sized,
impl<T> BorrowMut<T> for T where
T: ?Sized,
const: unstable · sourcepub fn borrow_mut(&mut self) -> &mut T
pub fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
sourceimpl<Q, K> Equivalent<K> for Q where
Q: Eq + ?Sized,
K: Borrow<Q> + ?Sized,
impl<Q, K> Equivalent<K> for Q where
Q: Eq + ?Sized,
K: Borrow<Q> + ?Sized,
sourcepub fn equivalent(&self, key: &K) -> bool
pub fn equivalent(&self, key: &K) -> bool
Compare self to key
and return true
if they are equal.
sourceimpl<T> Instrument for T
impl<T> Instrument for T
sourcefn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
sourcefn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
sourceimpl<T> ToOwned for T where
T: Clone,
impl<T> ToOwned for T where
T: Clone,
type Owned = T
type Owned = T
The resulting type after obtaining ownership.
sourcepub fn to_owned(&self) -> T
pub fn to_owned(&self) -> T
Creates owned data from borrowed data, usually by cloning. Read more
sourcepub fn clone_into(&self, target: &mut T)
pub fn clone_into(&self, target: &mut T)
toowned_clone_into
)Uses borrowed data to replace owned data, usually by cloning. Read more
sourceimpl<T> WithSubscriber for T
impl<T> WithSubscriber for T
sourcefn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> where
S: Into<Dispatch>,
fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> where
S: Into<Dispatch>,
Attaches the provided Subscriber
to this type, returning a
WithDispatch
wrapper. Read more
sourcefn with_current_subscriber(self) -> WithDispatch<Self>
fn with_current_subscriber(self) -> WithDispatch<Self>
Attaches the current default Subscriber
to this type, returning a
WithDispatch
wrapper. Read more