Struct OpenXJsonSerDe 

#[non_exhaustive]
pub struct OpenXJsonSerDe {
    pub convert_dots_in_json_keys_to_underscores: Option<bool>,
    pub case_insensitive: Option<bool>,
    pub column_to_json_key_mappings: Option<HashMap<String, String>>,
}

The OpenX SerDe. Used by Firehose for deserializing data, which means converting it from the JSON format in preparation for serializing it to the Parquet or ORC format. This is one of two deserializers you can choose, depending on which one offers the functionality you need. The other option is the native Hive / HCatalog JsonSerDe.

Fields (Non-exhaustive)

Non-exhaustive structs could have additional fields added in future. Therefore, non-exhaustive structs cannot be constructed in external crates using the traditional Struct { .. } syntax; cannot be matched against without a wildcard ..; and struct update syntax will not work.

convert_dots_in_json_keys_to_underscores: Option<bool>

When set to true, specifies that the names of the keys include dots and that you want Firehose to replace them with underscores. This is useful because Apache Hive does not allow dots in column names. For example, if the JSON contains a key whose name is "a.b", you can define the column name to be "a_b" when using this option.

The default is false.

case_insensitive: Option<bool>

When set to true, which is the default, Firehose converts JSON keys to lowercase before deserializing them.

column_to_json_key_mappings: Option<HashMap<String, String>>

Maps column names to JSON keys that aren't identical to the column names. This is useful when the JSON contains keys that are Hive keywords. For example, timestamp is a Hive keyword. If you have a JSON key named timestamp, set this parameter to {"ts": "timestamp"} to map this key to a column named ts.

Implementations

impl OpenXJsonSerDe

pub fn convert_dots_in_json_keys_to_underscores(&self) -> Option<bool>

When set to true, specifies that the names of the keys include dots and that you want Firehose to replace them with underscores. This is useful because Apache Hive does not allow dots in column names. For example, if the JSON contains a key whose name is "a.b", you can define the column name to be "a_b" when using this option.

The default is false.

pub fn case_insensitive(&self) -> Option<bool>

When set to true, which is the default, Firehose converts JSON keys to lowercase before deserializing them.

pub fn column_to_json_key_mappings(&self) -> Option<&HashMap<String, String>>

Maps column names to JSON keys that aren't identical to the column names. This is useful when the JSON contains keys that are Hive keywords. For example, timestamp is a Hive keyword. If you have a JSON key named timestamp, set this parameter to {"ts": "timestamp"} to map this key to a column named ts.

impl OpenXJsonSerDe

pub fn builder() -> OpenXJsonSerDeBuilder

Creates a new builder-style object to manufacture OpenXJsonSerDe.

Trait Implementations

impl Clone for OpenXJsonSerDe

fn clone(&self) -> OpenXJsonSerDe

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for OpenXJsonSerDe

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for OpenXJsonSerDe

fn eq(&self, other: &OpenXJsonSerDe) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for OpenXJsonSerDe