Enum parquet_format::ConvertedType

pub enum ConvertedType {
    Utf8,
    Map,
    MapKeyValue,
    List,
    Enum,
    Decimal,
    Date,
    TimeMillis,
    TimeMicros,
    TimestampMillis,
    TimestampMicros,
    Uint8,
    Uint16,
    Uint32,
    Uint64,
    Int8,
    Int16,
    Int32,
    Int64,
    Json,
    Bson,
    Interval,
}

Common types used by frameworks(e.g. hive, pig) using parquet. This helps map between types in those frameworks to the base types in parquet. This is only metadata and not needed to read or write the data.

Variants

Utf8

a BYTE_ARRAY actually contains UTF8 encoded chars

Map

a map is converted as an optional field containing a repeated key/value pair

MapKeyValue

a key/value pair is converted into a group of two fields

List

a list is converted into an optional field containing a repeated field for its values

Enum

an enum is converted into a binary field

Decimal

A decimal value.

This may be used to annotate binary or fixed primitive types. The underlying byte array stores the unscaled value encoded as two's complement using big-endian byte order (the most significant byte is the zeroth element). The value of the decimal is the value * 10^{-scale}.

This must be accompanied by a (maximum) precision and a scale in the SchemaElement. The precision specifies the number of digits in the decimal and the scale stores the location of the decimal point. For example 1.23 would have precision 3 (3 total digits) and scale 2 (the decimal point is 2 digits over).

Date

A Date

Stored as days since Unix epoch, encoded as the INT32 physical type.

TimeMillis

A time

The total number of milliseconds since midnight. The value is stored as an INT32 physical type.

TimeMicros

A time.

The total number of microseconds since midnight. The value is stored as an INT64 physical type.

TimestampMillis

A date/time combination

Date and time recorded as milliseconds since the Unix epoch. Recorded as a physical type of INT64.

TimestampMicros

A date/time combination

Date and time recorded as microseconds since the Unix epoch. The value is stored as an INT64 physical type.

Uint8

An unsigned integer value.

The number describes the maximum number of meaningful data bits in the stored value. 8, 16 and 32 bit values are stored using the INT32 physical type. 64 bit values are stored using the INT64 physical type.

Uint16

Uint32

Uint64

Int8

A signed integer value.

The number describes the maximum number of meaningful data bits in the stored value. 8, 16 and 32 bit values are stored using the INT32 physical type. 64 bit values are stored using the INT64 physical type.

Int16

Int32

Int64

Json

An embedded JSON document

A JSON document embedded within a single UTF8 column.

Bson

An embedded BSON document

A BSON document embedded within a single BINARY column.

Interval

An interval of time

This type annotates data stored as a FIXED_LEN_BYTE_ARRAY of length 12 This data is composed of three separate little endian unsigned integers. Each stores a component of a duration of time. The first integer identifies the number of months associated with the duration, the second identifies the number of days associated with the duration and the third identifies the number of milliseconds associated with the provided duration. This duration of time is independent of any particular timezone or date.

Implementations

impl ConvertedType

pub fn write_to_out_protocol(
    &self,
    o_prot: &mut dyn TOutputProtocol
) -> Result<()>

pub fn read_from_in_protocol(
    i_prot: &mut dyn TInputProtocol
) -> Result<ConvertedType>

Trait Implementations

impl Clone for ConvertedType

pub fn clone(&self) -> ConvertedType

Returns a copy of the value.

pub fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for ConvertedType

impl Debug for ConvertedType

pub fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for ConvertedType

impl Hash for ConvertedType

pub fn hash<__H: Hasher>(&self, state: &mut __H)

Feeds this value into the given Hasher.

pub fn hash_slice<H>(data: &[Self], state: &mut H) where
    H: Hasher, 

Feeds a slice of this type into the given Hasher.

impl Ord for ConvertedType

pub fn cmp(&self, other: &ConvertedType) -> Ordering

This method returns an Ordering between self and other.

#[must_use]pub fn max(self, other: Self) -> Self

Compares and returns the maximum of two values.

#[must_use]pub fn min(self, other: Self) -> Self

Compares and returns the minimum of two values.

#[must_use]pub fn clamp(self, min: Self, max: Self) -> Self

Restrict a value to a certain interval.

impl PartialEq<ConvertedType> for ConvertedType

pub fn eq(&self, other: &ConvertedType) -> bool

This method tests for self and other values to be equal, and is used by ==.

#[must_use]pub fn ne(&self, other: &Rhs) -> bool

This method tests for !=.

impl PartialOrd<ConvertedType> for ConvertedType

pub fn partial_cmp(&self, other: &ConvertedType) -> Option<Ordering>

This method returns an ordering between self and other values if one exists.

#[must_use]pub fn lt(&self, other: &Rhs) -> bool

This method tests less than (for self and other) and is used by the < operator.

#[must_use]pub fn le(&self, other: &Rhs) -> bool

This method tests less than or equal to (for self and other) and is used by the <= operator.

#[must_use]pub fn gt(&self, other: &Rhs) -> bool

This method tests greater than (for self and other) and is used by the > operator.

#[must_use]pub fn ge(&self, other: &Rhs) -> bool

This method tests greater than or equal to (for self and other) and is used by the >= operator.

impl StructuralEq for ConvertedType

impl StructuralPartialEq for ConvertedType

impl TryFrom<i32> for ConvertedType

type Error = Error

The type returned in the event of a conversion error.

pub fn try_from(i: i32) -> Result<Self, Self::Error>

Performs the conversion.