Struct aws_sdk_sagemaker::types::AutoMls3DataSource
source · #[non_exhaustive]pub struct AutoMls3DataSource {
pub s3_data_type: Option<AutoMls3DataType>,
pub s3_uri: Option<String>,
}
Expand description
Describes the Amazon S3 data source.
Fields (Non-exhaustive)§
This struct is marked as non-exhaustive
Struct { .. }
syntax; cannot be matched against without a wildcard ..
; and struct update syntax will not work.s3_data_type: Option<AutoMls3DataType>
The data type.
-
If you choose
S3Prefix
,S3Uri
identifies a key name prefix. SageMaker uses all objects that match the specified key name prefix for model training.The
S3Prefix
should have the following format:s3://DOC-EXAMPLE-BUCKET/DOC-EXAMPLE-FOLDER-OR-FILE
-
If you choose
ManifestFile
,S3Uri
identifies an object that is a manifest file containing a list of object keys that you want SageMaker to use for model training.A
ManifestFile
should have the format shown below:[ {"prefix": "s3://DOC-EXAMPLE-BUCKET/DOC-EXAMPLE-FOLDER/DOC-EXAMPLE-PREFIX/"},
"DOC-EXAMPLE-RELATIVE-PATH/DOC-EXAMPLE-FOLDER/DATA-1",
"DOC-EXAMPLE-RELATIVE-PATH/DOC-EXAMPLE-FOLDER/DATA-2",
... "DOC-EXAMPLE-RELATIVE-PATH/DOC-EXAMPLE-FOLDER/DATA-N" ]
-
If you choose
AugmentedManifestFile
,S3Uri
identifies an object that is an augmented manifest file in JSON lines format. This file contains the data you want to use for model training.AugmentedManifestFile
is available for V2 API jobs only (for example, for jobs created by callingCreateAutoMLJobV2
).Here is a minimal, single-record example of an
AugmentedManifestFile
:{"source-ref": "s3://DOC-EXAMPLE-BUCKET/DOC-EXAMPLE-FOLDER/cats/cat.jpg",
"label-metadata": {"class-name": "cat"
}For more information on
AugmentedManifestFile
, see Provide Dataset Metadata to Training Jobs with an Augmented Manifest File.
s3_uri: Option<String>
The URL to the Amazon S3 data source. The Uri refers to the Amazon S3 prefix or ManifestFile depending on the data type.
Implementations§
source§impl AutoMls3DataSource
impl AutoMls3DataSource
sourcepub fn s3_data_type(&self) -> Option<&AutoMls3DataType>
pub fn s3_data_type(&self) -> Option<&AutoMls3DataType>
The data type.
-
If you choose
S3Prefix
,S3Uri
identifies a key name prefix. SageMaker uses all objects that match the specified key name prefix for model training.The
S3Prefix
should have the following format:s3://DOC-EXAMPLE-BUCKET/DOC-EXAMPLE-FOLDER-OR-FILE
-
If you choose
ManifestFile
,S3Uri
identifies an object that is a manifest file containing a list of object keys that you want SageMaker to use for model training.A
ManifestFile
should have the format shown below:[ {"prefix": "s3://DOC-EXAMPLE-BUCKET/DOC-EXAMPLE-FOLDER/DOC-EXAMPLE-PREFIX/"},
"DOC-EXAMPLE-RELATIVE-PATH/DOC-EXAMPLE-FOLDER/DATA-1",
"DOC-EXAMPLE-RELATIVE-PATH/DOC-EXAMPLE-FOLDER/DATA-2",
... "DOC-EXAMPLE-RELATIVE-PATH/DOC-EXAMPLE-FOLDER/DATA-N" ]
-
If you choose
AugmentedManifestFile
,S3Uri
identifies an object that is an augmented manifest file in JSON lines format. This file contains the data you want to use for model training.AugmentedManifestFile
is available for V2 API jobs only (for example, for jobs created by callingCreateAutoMLJobV2
).Here is a minimal, single-record example of an
AugmentedManifestFile
:{"source-ref": "s3://DOC-EXAMPLE-BUCKET/DOC-EXAMPLE-FOLDER/cats/cat.jpg",
"label-metadata": {"class-name": "cat"
}For more information on
AugmentedManifestFile
, see Provide Dataset Metadata to Training Jobs with an Augmented Manifest File.
source§impl AutoMls3DataSource
impl AutoMls3DataSource
sourcepub fn builder() -> AutoMls3DataSourceBuilder
pub fn builder() -> AutoMls3DataSourceBuilder
Creates a new builder-style object to manufacture AutoMls3DataSource
.
Trait Implementations§
source§impl Clone for AutoMls3DataSource
impl Clone for AutoMls3DataSource
source§fn clone(&self) -> AutoMls3DataSource
fn clone(&self) -> AutoMls3DataSource
1.0.0 · source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source
. Read moresource§impl Debug for AutoMls3DataSource
impl Debug for AutoMls3DataSource
source§impl PartialEq<AutoMls3DataSource> for AutoMls3DataSource
impl PartialEq<AutoMls3DataSource> for AutoMls3DataSource
source§fn eq(&self, other: &AutoMls3DataSource) -> bool
fn eq(&self, other: &AutoMls3DataSource) -> bool
self
and other
values to be equal, and is used
by ==
.