Struct rusoto_sagemaker::ShuffleConfig
source · [−]pub struct ShuffleConfig {
pub seed: i64,
}
Expand description
A configuration for a shuffle option for input data in a channel. If you use S3Prefix
for S3DataType
, the results of the S3 key prefix matches are shuffled. If you use ManifestFile
, the order of the S3 object references in the ManifestFile
is shuffled. If you use AugmentedManifestFile
, the order of the JSON lines in the AugmentedManifestFile
is shuffled. The shuffling order is determined using the Seed
value.
For Pipe input mode, when ShuffleConfig
is specified shuffling is done at the start of every epoch. With large datasets, this ensures that the order of the training data is different for each epoch, and it helps reduce bias and possible overfitting. In a multi-node training job when ShuffleConfig
is combined with S3DataDistributionType
of ShardedByS3Key
, the data is shuffled across nodes so that the content sent to a particular node on the first epoch might be sent to a different node on the second epoch.
Fields
seed: i64
Determines the shuffling order in ShuffleConfig
value.
Trait Implementations
sourceimpl Clone for ShuffleConfig
impl Clone for ShuffleConfig
sourcefn clone(&self) -> ShuffleConfig
fn clone(&self) -> ShuffleConfig
Returns a copy of the value. Read more
1.0.0 · sourcefn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from source
. Read more
sourceimpl Debug for ShuffleConfig
impl Debug for ShuffleConfig
sourceimpl Default for ShuffleConfig
impl Default for ShuffleConfig
sourcefn default() -> ShuffleConfig
fn default() -> ShuffleConfig
Returns the “default value” for a type. Read more
sourceimpl<'de> Deserialize<'de> for ShuffleConfig
impl<'de> Deserialize<'de> for ShuffleConfig
sourcefn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error> where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error> where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
sourceimpl PartialEq<ShuffleConfig> for ShuffleConfig
impl PartialEq<ShuffleConfig> for ShuffleConfig
sourcefn eq(&self, other: &ShuffleConfig) -> bool
fn eq(&self, other: &ShuffleConfig) -> bool
This method tests for self
and other
values to be equal, and is used
by ==
. Read more
sourcefn ne(&self, other: &ShuffleConfig) -> bool
fn ne(&self, other: &ShuffleConfig) -> bool
This method tests for !=
.
sourceimpl Serialize for ShuffleConfig
impl Serialize for ShuffleConfig
impl StructuralPartialEq for ShuffleConfig
Auto Trait Implementations
impl RefUnwindSafe for ShuffleConfig
impl Send for ShuffleConfig
impl Sync for ShuffleConfig
impl Unpin for ShuffleConfig
impl UnwindSafe for ShuffleConfig
Blanket Implementations
sourceimpl<T> BorrowMut<T> for T where
T: ?Sized,
impl<T> BorrowMut<T> for T where
T: ?Sized,
const: unstable · sourcefn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
sourceimpl<T> Instrument for T
impl<T> Instrument for T
sourcefn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
sourcefn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
sourceimpl<T> ToOwned for T where
T: Clone,
impl<T> ToOwned for T where
T: Clone,
type Owned = T
type Owned = T
The resulting type after obtaining ownership.
sourcefn clone_into(&self, target: &mut T)
fn clone_into(&self, target: &mut T)
toowned_clone_into
)Uses borrowed data to replace owned data, usually by cloning. Read more
sourceimpl<T> WithSubscriber for T
impl<T> WithSubscriber for T
sourcefn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> where
S: Into<Dispatch>,
fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> where
S: Into<Dispatch>,
Attaches the provided Subscriber
to this type, returning a
WithDispatch
wrapper. Read more
sourcefn with_current_subscriber(self) -> WithDispatch<Self>
fn with_current_subscriber(self) -> WithDispatch<Self>
Attaches the current default Subscriber
to this type, returning a
WithDispatch
wrapper. Read more