Struct rusoto_sagemaker::ProcessingS3Input
source · [−]pub struct ProcessingS3Input {
pub local_path: Option<String>,
pub s3_compression_type: Option<String>,
pub s3_data_distribution_type: Option<String>,
pub s3_data_type: String,
pub s3_input_mode: Option<String>,
pub s3_uri: String,
}
Expand description
Configuration for downloading input data from Amazon S3 into the processing container.
Fields
local_path: Option<String>
The local path in your container where you want Amazon SageMaker to write input data to. LocalPath
is an absolute path to the input data and must begin with /opt/ml/processing/
. LocalPath
is a required parameter when AppManaged
is False
(default).
s3_compression_type: Option<String>
Whether to GZIP-decompress the data in Amazon S3 as it is streamed into the processing container. Gzip
can only be used when Pipe
mode is specified as the S3InputMode
. In Pipe
mode, Amazon SageMaker streams input data from the source directly to your container without using the EBS volume.
s3_data_distribution_type: Option<String>
Whether to distribute the data from Amazon S3 to all processing instances with FullyReplicated
, or whether the data from Amazon S3 is shared by Amazon S3 key, downloading one shard of data to each processing instance.
s3_data_type: String
Whether you use an S3Prefix
or a ManifestFile
for the data type. If you choose S3Prefix
, S3Uri
identifies a key name prefix. Amazon SageMaker uses all objects with the specified key name prefix for the processing job. If you choose ManifestFile
, S3Uri
identifies an object that is a manifest file containing a list of object keys that you want Amazon SageMaker to use for the processing job.
s3_input_mode: Option<String>
Whether to use File
or Pipe
input mode. In File mode, Amazon SageMaker copies the data from the input source onto the local ML storage volume before starting your processing container. This is the most commonly used input mode. In Pipe
mode, Amazon SageMaker streams input data from the source directly to your processing container into named pipes without using the ML storage volume.
s3_uri: String
The URI of the Amazon S3 prefix Amazon SageMaker downloads data required to run a processing job.
Trait Implementations
sourceimpl Clone for ProcessingS3Input
impl Clone for ProcessingS3Input
sourcefn clone(&self) -> ProcessingS3Input
fn clone(&self) -> ProcessingS3Input
Returns a copy of the value. Read more
1.0.0 · sourcefn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from source
. Read more
sourceimpl Debug for ProcessingS3Input
impl Debug for ProcessingS3Input
sourceimpl Default for ProcessingS3Input
impl Default for ProcessingS3Input
sourcefn default() -> ProcessingS3Input
fn default() -> ProcessingS3Input
Returns the “default value” for a type. Read more
sourceimpl<'de> Deserialize<'de> for ProcessingS3Input
impl<'de> Deserialize<'de> for ProcessingS3Input
sourcefn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error> where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error> where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
sourceimpl PartialEq<ProcessingS3Input> for ProcessingS3Input
impl PartialEq<ProcessingS3Input> for ProcessingS3Input
sourcefn eq(&self, other: &ProcessingS3Input) -> bool
fn eq(&self, other: &ProcessingS3Input) -> bool
This method tests for self
and other
values to be equal, and is used
by ==
. Read more
sourcefn ne(&self, other: &ProcessingS3Input) -> bool
fn ne(&self, other: &ProcessingS3Input) -> bool
This method tests for !=
.
sourceimpl Serialize for ProcessingS3Input
impl Serialize for ProcessingS3Input
impl StructuralPartialEq for ProcessingS3Input
Auto Trait Implementations
impl RefUnwindSafe for ProcessingS3Input
impl Send for ProcessingS3Input
impl Sync for ProcessingS3Input
impl Unpin for ProcessingS3Input
impl UnwindSafe for ProcessingS3Input
Blanket Implementations
sourceimpl<T> BorrowMut<T> for T where
T: ?Sized,
impl<T> BorrowMut<T> for T where
T: ?Sized,
const: unstable · sourcefn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
sourceimpl<T> Instrument for T
impl<T> Instrument for T
sourcefn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
sourcefn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
sourceimpl<T> ToOwned for T where
T: Clone,
impl<T> ToOwned for T where
T: Clone,
type Owned = T
type Owned = T
The resulting type after obtaining ownership.
sourcefn clone_into(&self, target: &mut T)
fn clone_into(&self, target: &mut T)
toowned_clone_into
)Uses borrowed data to replace owned data, usually by cloning. Read more
sourceimpl<T> WithSubscriber for T
impl<T> WithSubscriber for T
sourcefn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> where
S: Into<Dispatch>,
fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> where
S: Into<Dispatch>,
Attaches the provided Subscriber
to this type, returning a
WithDispatch
wrapper. Read more
sourcefn with_current_subscriber(self) -> WithDispatch<Self>
fn with_current_subscriber(self) -> WithDispatch<Self>
Attaches the current default Subscriber
to this type, returning a
WithDispatch
wrapper. Read more