Struct aws_sdk_sagemaker::model::processing_s3_input::Builder
source · [−]#[non_exhaustive]pub struct Builder { /* private fields */ }
Expand description
A builder for ProcessingS3Input
Implementations
sourceimpl Builder
impl Builder
sourcepub fn s3_uri(self, input: impl Into<String>) -> Self
pub fn s3_uri(self, input: impl Into<String>) -> Self
The URI of the Amazon S3 prefix Amazon SageMaker downloads data required to run a processing job.
sourcepub fn set_s3_uri(self, input: Option<String>) -> Self
pub fn set_s3_uri(self, input: Option<String>) -> Self
The URI of the Amazon S3 prefix Amazon SageMaker downloads data required to run a processing job.
sourcepub fn local_path(self, input: impl Into<String>) -> Self
pub fn local_path(self, input: impl Into<String>) -> Self
The local path in your container where you want Amazon SageMaker to write input data to. LocalPath
is an absolute path to the input data and must begin with /opt/ml/processing/
. LocalPath
is a required parameter when AppManaged
is False
(default).
sourcepub fn set_local_path(self, input: Option<String>) -> Self
pub fn set_local_path(self, input: Option<String>) -> Self
The local path in your container where you want Amazon SageMaker to write input data to. LocalPath
is an absolute path to the input data and must begin with /opt/ml/processing/
. LocalPath
is a required parameter when AppManaged
is False
(default).
sourcepub fn s3_data_type(self, input: ProcessingS3DataType) -> Self
pub fn s3_data_type(self, input: ProcessingS3DataType) -> Self
Whether you use an S3Prefix
or a ManifestFile
for the data type. If you choose S3Prefix
, S3Uri
identifies a key name prefix. Amazon SageMaker uses all objects with the specified key name prefix for the processing job. If you choose ManifestFile
, S3Uri
identifies an object that is a manifest file containing a list of object keys that you want Amazon SageMaker to use for the processing job.
sourcepub fn set_s3_data_type(self, input: Option<ProcessingS3DataType>) -> Self
pub fn set_s3_data_type(self, input: Option<ProcessingS3DataType>) -> Self
Whether you use an S3Prefix
or a ManifestFile
for the data type. If you choose S3Prefix
, S3Uri
identifies a key name prefix. Amazon SageMaker uses all objects with the specified key name prefix for the processing job. If you choose ManifestFile
, S3Uri
identifies an object that is a manifest file containing a list of object keys that you want Amazon SageMaker to use for the processing job.
sourcepub fn s3_input_mode(self, input: ProcessingS3InputMode) -> Self
pub fn s3_input_mode(self, input: ProcessingS3InputMode) -> Self
Whether to use File
or Pipe
input mode. In File mode, Amazon SageMaker copies the data from the input source onto the local ML storage volume before starting your processing container. This is the most commonly used input mode. In Pipe
mode, Amazon SageMaker streams input data from the source directly to your processing container into named pipes without using the ML storage volume.
sourcepub fn set_s3_input_mode(self, input: Option<ProcessingS3InputMode>) -> Self
pub fn set_s3_input_mode(self, input: Option<ProcessingS3InputMode>) -> Self
Whether to use File
or Pipe
input mode. In File mode, Amazon SageMaker copies the data from the input source onto the local ML storage volume before starting your processing container. This is the most commonly used input mode. In Pipe
mode, Amazon SageMaker streams input data from the source directly to your processing container into named pipes without using the ML storage volume.
sourcepub fn s3_data_distribution_type(
self,
input: ProcessingS3DataDistributionType
) -> Self
pub fn s3_data_distribution_type(
self,
input: ProcessingS3DataDistributionType
) -> Self
Whether to distribute the data from Amazon S3 to all processing instances with FullyReplicated
, or whether the data from Amazon S3 is shared by Amazon S3 key, downloading one shard of data to each processing instance.
sourcepub fn set_s3_data_distribution_type(
self,
input: Option<ProcessingS3DataDistributionType>
) -> Self
pub fn set_s3_data_distribution_type(
self,
input: Option<ProcessingS3DataDistributionType>
) -> Self
Whether to distribute the data from Amazon S3 to all processing instances with FullyReplicated
, or whether the data from Amazon S3 is shared by Amazon S3 key, downloading one shard of data to each processing instance.
sourcepub fn s3_compression_type(self, input: ProcessingS3CompressionType) -> Self
pub fn s3_compression_type(self, input: ProcessingS3CompressionType) -> Self
Whether to GZIP-decompress the data in Amazon S3 as it is streamed into the processing container. Gzip
can only be used when Pipe
mode is specified as the S3InputMode
. In Pipe
mode, Amazon SageMaker streams input data from the source directly to your container without using the EBS volume.
sourcepub fn set_s3_compression_type(
self,
input: Option<ProcessingS3CompressionType>
) -> Self
pub fn set_s3_compression_type(
self,
input: Option<ProcessingS3CompressionType>
) -> Self
Whether to GZIP-decompress the data in Amazon S3 as it is streamed into the processing container. Gzip
can only be used when Pipe
mode is specified as the S3InputMode
. In Pipe
mode, Amazon SageMaker streams input data from the source directly to your container without using the EBS volume.
sourcepub fn build(self) -> ProcessingS3Input
pub fn build(self) -> ProcessingS3Input
Consumes the builder and constructs a ProcessingS3Input
Trait Implementations
impl StructuralPartialEq for Builder
Auto Trait Implementations
impl RefUnwindSafe for Builder
impl Send for Builder
impl Sync for Builder
impl Unpin for Builder
impl UnwindSafe for Builder
Blanket Implementations
sourceimpl<T> BorrowMut<T> for T where
T: ?Sized,
impl<T> BorrowMut<T> for T where
T: ?Sized,
const: unstable · sourcepub fn borrow_mut(&mut self) -> &mut T
pub fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
sourceimpl<T> Instrument for T
impl<T> Instrument for T
sourcefn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
sourcefn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
sourceimpl<T> ToOwned for T where
T: Clone,
impl<T> ToOwned for T where
T: Clone,
type Owned = T
type Owned = T
The resulting type after obtaining ownership.
sourcepub fn to_owned(&self) -> T
pub fn to_owned(&self) -> T
Creates owned data from borrowed data, usually by cloning. Read more
sourcepub fn clone_into(&self, target: &mut T)
pub fn clone_into(&self, target: &mut T)
toowned_clone_into
)Uses borrowed data to replace owned data, usually by cloning. Read more
sourceimpl<T> WithSubscriber for T
impl<T> WithSubscriber for T
sourcefn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> where
S: Into<Dispatch>,
fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> where
S: Into<Dispatch>,
Attaches the provided Subscriber
to this type, returning a
WithDispatch
wrapper. Read more
sourcefn with_current_subscriber(self) -> WithDispatch<Self>
fn with_current_subscriber(self) -> WithDispatch<Self>
Attaches the current default Subscriber
to this type, returning a
WithDispatch
wrapper. Read more