Struct aws_sdk_firehose::model::OpenXJsonSerDe
source ·
[−]#[non_exhaustive]pub struct OpenXJsonSerDe {
pub convert_dots_in_json_keys_to_underscores: Option<bool>,
pub case_insensitive: Option<bool>,
pub column_to_json_key_mappings: Option<HashMap<String, String>>,
}
Expand description
The OpenX SerDe. Used by Kinesis Data Firehose for deserializing data, which means converting it from the JSON format in preparation for serializing it to the Parquet or ORC format. This is one of two deserializers you can choose, depending on which one offers the functionality you need. The other option is the native Hive / HCatalog JsonSerDe.
Fields (Non-exhaustive)
This struct is marked as non-exhaustive
Struct { .. }
syntax; cannot be matched against without a wildcard ..
; and struct update syntax will not work.convert_dots_in_json_keys_to_underscores: Option<bool>
When set to true
, specifies that the names of the keys include dots and that you want Kinesis Data Firehose to replace them with underscores. This is useful because Apache Hive does not allow dots in column names. For example, if the JSON contains a key whose name is "a.b", you can define the column name to be "a_b" when using this option.
The default is false
.
case_insensitive: Option<bool>
When set to true
, which is the default, Kinesis Data Firehose converts JSON keys to lowercase before deserializing them.
column_to_json_key_mappings: Option<HashMap<String, String>>
Maps column names to JSON keys that aren't identical to the column names. This is useful when the JSON contains keys that are Hive keywords. For example, timestamp
is a Hive keyword. If you have a JSON key named timestamp
, set this parameter to {"ts": "timestamp"}
to map this key to a column named ts
.
Implementations
When set to true
, specifies that the names of the keys include dots and that you want Kinesis Data Firehose to replace them with underscores. This is useful because Apache Hive does not allow dots in column names. For example, if the JSON contains a key whose name is "a.b", you can define the column name to be "a_b" when using this option.
The default is false
.
When set to true
, which is the default, Kinesis Data Firehose converts JSON keys to lowercase before deserializing them.
Maps column names to JSON keys that aren't identical to the column names. This is useful when the JSON contains keys that are Hive keywords. For example, timestamp
is a Hive keyword. If you have a JSON key named timestamp
, set this parameter to {"ts": "timestamp"}
to map this key to a column named ts
.
Creates a new builder-style object to manufacture OpenXJsonSerDe
Trait Implementations
This method tests for self
and other
values to be equal, and is used
by ==
. Read more
This method tests for !=
.
Auto Trait Implementations
impl RefUnwindSafe for OpenXJsonSerDe
impl Send for OpenXJsonSerDe
impl Sync for OpenXJsonSerDe
impl Unpin for OpenXJsonSerDe
impl UnwindSafe for OpenXJsonSerDe
Blanket Implementations
Mutably borrows from an owned value. Read more
Attaches the provided Subscriber
to this type, returning a
WithDispatch
wrapper. Read more
Attaches the current default Subscriber
to this type, returning a
WithDispatch
wrapper. Read more