Struct rusoto_firehose::ParquetSerDe
source · [−]pub struct ParquetSerDe {
pub block_size_bytes: Option<i64>,
pub compression: Option<String>,
pub enable_dictionary_compression: Option<bool>,
pub max_padding_bytes: Option<i64>,
pub page_size_bytes: Option<i64>,
pub writer_version: Option<String>,
}
Expand description
A serializer to use for converting data to the Parquet format before storing it in Amazon S3. For more information, see Apache Parquet.
Fields
block_size_bytes: Option<i64>
The Hadoop Distributed File System (HDFS) block size. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is 256 MiB and the minimum is 64 MiB. Kinesis Data Firehose uses this value for padding calculations.
compression: Option<String>
The compression code to use over data blocks. The possible values are UNCOMPRESSED
, SNAPPY
, and GZIP
, with the default being SNAPPY
. Use SNAPPY
for higher decompression speed. Use GZIP
if the compression ratio is more important than speed.
enable_dictionary_compression: Option<bool>
Indicates whether to enable dictionary compression.
max_padding_bytes: Option<i64>
The maximum amount of padding to apply. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is 0.
page_size_bytes: Option<i64>
The Parquet page size. Column chunks are divided into pages. A page is conceptually an indivisible unit (in terms of compression and encoding). The minimum value is 64 KiB and the default is 1 MiB.
writer_version: Option<String>
Indicates the version of row format to output. The possible values are V1
and V2
. The default is V1
.
Trait Implementations
sourceimpl Clone for ParquetSerDe
impl Clone for ParquetSerDe
sourcefn clone(&self) -> ParquetSerDe
fn clone(&self) -> ParquetSerDe
Returns a copy of the value. Read more
1.0.0 · sourcefn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from source
. Read more
sourceimpl Debug for ParquetSerDe
impl Debug for ParquetSerDe
sourceimpl Default for ParquetSerDe
impl Default for ParquetSerDe
sourcefn default() -> ParquetSerDe
fn default() -> ParquetSerDe
Returns the “default value” for a type. Read more
sourceimpl<'de> Deserialize<'de> for ParquetSerDe
impl<'de> Deserialize<'de> for ParquetSerDe
sourcefn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error> where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error> where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
sourceimpl PartialEq<ParquetSerDe> for ParquetSerDe
impl PartialEq<ParquetSerDe> for ParquetSerDe
sourcefn eq(&self, other: &ParquetSerDe) -> bool
fn eq(&self, other: &ParquetSerDe) -> bool
This method tests for self
and other
values to be equal, and is used
by ==
. Read more
sourcefn ne(&self, other: &ParquetSerDe) -> bool
fn ne(&self, other: &ParquetSerDe) -> bool
This method tests for !=
.
sourceimpl Serialize for ParquetSerDe
impl Serialize for ParquetSerDe
impl StructuralPartialEq for ParquetSerDe
Auto Trait Implementations
impl RefUnwindSafe for ParquetSerDe
impl Send for ParquetSerDe
impl Sync for ParquetSerDe
impl Unpin for ParquetSerDe
impl UnwindSafe for ParquetSerDe
Blanket Implementations
sourceimpl<T> BorrowMut<T> for T where
T: ?Sized,
impl<T> BorrowMut<T> for T where
T: ?Sized,
const: unstable · sourcefn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
sourceimpl<T> Instrument for T
impl<T> Instrument for T
sourcefn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
sourcefn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
sourceimpl<T> ToOwned for T where
T: Clone,
impl<T> ToOwned for T where
T: Clone,
type Owned = T
type Owned = T
The resulting type after obtaining ownership.
sourcefn clone_into(&self, target: &mut T)
fn clone_into(&self, target: &mut T)
toowned_clone_into
)Uses borrowed data to replace owned data, usually by cloning. Read more
sourceimpl<T> WithSubscriber for T
impl<T> WithSubscriber for T
sourcefn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> where
S: Into<Dispatch>,
fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> where
S: Into<Dispatch>,
Attaches the provided Subscriber
to this type, returning a
WithDispatch
wrapper. Read more
sourcefn with_current_subscriber(self) -> WithDispatch<Self>
fn with_current_subscriber(self) -> WithDispatch<Self>
Attaches the current default Subscriber
to this type, returning a
WithDispatch
wrapper. Read more