Struct aws_sdk_firehose::model::orc_ser_de::Builder
source · [−]#[non_exhaustive]pub struct Builder { /* private fields */ }
Expand description
A builder for OrcSerDe
Implementations
sourceimpl Builder
impl Builder
sourcepub fn stripe_size_bytes(self, input: i32) -> Self
pub fn stripe_size_bytes(self, input: i32) -> Self
The number of bytes in each stripe. The default is 64 MiB and the minimum is 8 MiB.
sourcepub fn set_stripe_size_bytes(self, input: Option<i32>) -> Self
pub fn set_stripe_size_bytes(self, input: Option<i32>) -> Self
The number of bytes in each stripe. The default is 64 MiB and the minimum is 8 MiB.
sourcepub fn block_size_bytes(self, input: i32) -> Self
pub fn block_size_bytes(self, input: i32) -> Self
The Hadoop Distributed File System (HDFS) block size. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is 256 MiB and the minimum is 64 MiB. Kinesis Data Firehose uses this value for padding calculations.
sourcepub fn set_block_size_bytes(self, input: Option<i32>) -> Self
pub fn set_block_size_bytes(self, input: Option<i32>) -> Self
The Hadoop Distributed File System (HDFS) block size. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is 256 MiB and the minimum is 64 MiB. Kinesis Data Firehose uses this value for padding calculations.
sourcepub fn row_index_stride(self, input: i32) -> Self
pub fn row_index_stride(self, input: i32) -> Self
The number of rows between index entries. The default is 10,000 and the minimum is 1,000.
sourcepub fn set_row_index_stride(self, input: Option<i32>) -> Self
pub fn set_row_index_stride(self, input: Option<i32>) -> Self
The number of rows between index entries. The default is 10,000 and the minimum is 1,000.
sourcepub fn enable_padding(self, input: bool) -> Self
pub fn enable_padding(self, input: bool) -> Self
Set this to true
to indicate that you want stripes to be padded to the HDFS block boundaries. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is false
.
sourcepub fn set_enable_padding(self, input: Option<bool>) -> Self
pub fn set_enable_padding(self, input: Option<bool>) -> Self
Set this to true
to indicate that you want stripes to be padded to the HDFS block boundaries. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is false
.
sourcepub fn padding_tolerance(self, input: f64) -> Self
pub fn padding_tolerance(self, input: f64) -> Self
A number between 0 and 1 that defines the tolerance for block padding as a decimal fraction of stripe size. The default value is 0.05, which means 5 percent of stripe size.
For the default values of 64 MiB ORC stripes and 256 MiB HDFS blocks, the default block padding tolerance of 5 percent reserves a maximum of 3.2 MiB for padding within the 256 MiB block. In such a case, if the available size within the block is more than 3.2 MiB, a new, smaller stripe is inserted to fit within that space. This ensures that no stripe crosses block boundaries and causes remote reads within a node-local task.
Kinesis Data Firehose ignores this parameter when OrcSerDe$EnablePadding
is false
.
sourcepub fn set_padding_tolerance(self, input: Option<f64>) -> Self
pub fn set_padding_tolerance(self, input: Option<f64>) -> Self
A number between 0 and 1 that defines the tolerance for block padding as a decimal fraction of stripe size. The default value is 0.05, which means 5 percent of stripe size.
For the default values of 64 MiB ORC stripes and 256 MiB HDFS blocks, the default block padding tolerance of 5 percent reserves a maximum of 3.2 MiB for padding within the 256 MiB block. In such a case, if the available size within the block is more than 3.2 MiB, a new, smaller stripe is inserted to fit within that space. This ensures that no stripe crosses block boundaries and causes remote reads within a node-local task.
Kinesis Data Firehose ignores this parameter when OrcSerDe$EnablePadding
is false
.
sourcepub fn compression(self, input: OrcCompression) -> Self
pub fn compression(self, input: OrcCompression) -> Self
The compression code to use over data blocks. The default is SNAPPY
.
sourcepub fn set_compression(self, input: Option<OrcCompression>) -> Self
pub fn set_compression(self, input: Option<OrcCompression>) -> Self
The compression code to use over data blocks. The default is SNAPPY
.
sourcepub fn bloom_filter_columns(self, input: impl Into<String>) -> Self
pub fn bloom_filter_columns(self, input: impl Into<String>) -> Self
Appends an item to bloom_filter_columns
.
To override the contents of this collection use set_bloom_filter_columns
.
The column names for which you want Kinesis Data Firehose to create bloom filters. The default is null
.
sourcepub fn set_bloom_filter_columns(self, input: Option<Vec<String>>) -> Self
pub fn set_bloom_filter_columns(self, input: Option<Vec<String>>) -> Self
The column names for which you want Kinesis Data Firehose to create bloom filters. The default is null
.
sourcepub fn bloom_filter_false_positive_probability(self, input: f64) -> Self
pub fn bloom_filter_false_positive_probability(self, input: f64) -> Self
The Bloom filter false positive probability (FPP). The lower the FPP, the bigger the Bloom filter. The default value is 0.05, the minimum is 0, and the maximum is 1.
sourcepub fn set_bloom_filter_false_positive_probability(
self,
input: Option<f64>
) -> Self
pub fn set_bloom_filter_false_positive_probability(
self,
input: Option<f64>
) -> Self
The Bloom filter false positive probability (FPP). The lower the FPP, the bigger the Bloom filter. The default value is 0.05, the minimum is 0, and the maximum is 1.
sourcepub fn dictionary_key_threshold(self, input: f64) -> Self
pub fn dictionary_key_threshold(self, input: f64) -> Self
Represents the fraction of the total number of non-null rows. To turn off dictionary encoding, set this fraction to a number that is less than the number of distinct keys in a dictionary. To always use dictionary encoding, set this threshold to 1.
sourcepub fn set_dictionary_key_threshold(self, input: Option<f64>) -> Self
pub fn set_dictionary_key_threshold(self, input: Option<f64>) -> Self
Represents the fraction of the total number of non-null rows. To turn off dictionary encoding, set this fraction to a number that is less than the number of distinct keys in a dictionary. To always use dictionary encoding, set this threshold to 1.
sourcepub fn format_version(self, input: OrcFormatVersion) -> Self
pub fn format_version(self, input: OrcFormatVersion) -> Self
The version of the file to write. The possible values are V0_11
and V0_12
. The default is V0_12
.
sourcepub fn set_format_version(self, input: Option<OrcFormatVersion>) -> Self
pub fn set_format_version(self, input: Option<OrcFormatVersion>) -> Self
The version of the file to write. The possible values are V0_11
and V0_12
. The default is V0_12
.
Trait Implementations
impl StructuralPartialEq for Builder
Auto Trait Implementations
impl RefUnwindSafe for Builder
impl Send for Builder
impl Sync for Builder
impl Unpin for Builder
impl UnwindSafe for Builder
Blanket Implementations
sourceimpl<T> BorrowMut<T> for T where
T: ?Sized,
impl<T> BorrowMut<T> for T where
T: ?Sized,
const: unstable · sourcefn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
sourceimpl<T> Instrument for T
impl<T> Instrument for T
sourcefn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
sourcefn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
sourceimpl<T> ToOwned for T where
T: Clone,
impl<T> ToOwned for T where
T: Clone,
type Owned = T
type Owned = T
The resulting type after obtaining ownership.
sourcefn clone_into(&self, target: &mut T)
fn clone_into(&self, target: &mut T)
toowned_clone_into
)Uses borrowed data to replace owned data, usually by cloning. Read more
sourceimpl<T> WithSubscriber for T
impl<T> WithSubscriber for T
sourcefn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> where
S: Into<Dispatch>,
fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self> where
S: Into<Dispatch>,
Attaches the provided Subscriber
to this type, returning a
WithDispatch
wrapper. Read more
sourcefn with_current_subscriber(self) -> WithDispatch<Self>
fn with_current_subscriber(self) -> WithDispatch<Self>
Attaches the current default Subscriber
to this type, returning a
WithDispatch
wrapper. Read more