Enum arrow::datatypes::DataType [−][src]
pub enum DataType {
Show 33 variants
Null,
Boolean,
Int8,
Int16,
Int32,
Int64,
UInt8,
UInt16,
UInt32,
UInt64,
Float16,
Float32,
Float64,
Timestamp(TimeUnit, Option<String>),
Date32,
Date64,
Time32(TimeUnit),
Time64(TimeUnit),
Duration(TimeUnit),
Interval(IntervalUnit),
Binary,
FixedSizeBinary(i32),
LargeBinary,
Utf8,
LargeUtf8,
List(Box<Field>),
FixedSizeList(Box<Field>, i32),
LargeList(Box<Field>),
Struct(Vec<Field>),
Union(Vec<Field>),
Dictionary(Box<DataType>, Box<DataType>),
Decimal(usize, usize),
Map(Box<Field>, bool),
}
Expand description
The set of datatypes that are supported by this implementation of Apache Arrow.
The Arrow specification on data types includes some more types.
See also Schema.fbs
for Arrow’s specification.
The variants of this enum include primitive fixed size types as well as parametric or nested types. Currently the Rust implementation supports the following nested types:
List<T>
Struct<T, U, V, ...>
Nested types can themselves be nested within other arrays. For more information on these types please see the physical memory layout of Apache Arrow.
Variants
Null
Null type
Boolean
A boolean datatype representing the values true
and false
.
Int8
A signed 8-bit integer.
Int16
A signed 16-bit integer.
Int32
A signed 32-bit integer.
Int64
A signed 64-bit integer.
UInt8
An unsigned 8-bit integer.
UInt16
An unsigned 16-bit integer.
UInt32
An unsigned 32-bit integer.
UInt64
An unsigned 64-bit integer.
Float16
A 16-bit floating point number.
Float32
A 32-bit floating point number.
Float64
A 64-bit floating point number.
Timestamp(TimeUnit, Option<String>)
A timestamp with an optional timezone.
Time is measured as a Unix epoch, counting the seconds from 00:00:00.000 on 1 January 1970, excluding leap seconds, as a 64-bit integer.
The time zone is a string indicating the name of a time zone, one of:
- As used in the Olson time zone database (the “tz database” or “tzdata”), such as “America/New_York”
- An absolute time zone offset of the form +XX:XX or -XX:XX, such as +07:30
Date32
A 32-bit date representing the elapsed time since UNIX epoch (1970-01-01) in days (32 bits).
Date64
A 64-bit date representing the elapsed time since UNIX epoch (1970-01-01) in milliseconds (64 bits). Values are evenly divisible by 86400000.
Time32(TimeUnit)
Tuple Fields
0: TimeUnit
A 32-bit time representing the elapsed time since midnight in the unit of TimeUnit
.
Time64(TimeUnit)
Tuple Fields
0: TimeUnit
A 64-bit time representing the elapsed time since midnight in the unit of TimeUnit
.
Duration(TimeUnit)
Tuple Fields
0: TimeUnit
Measure of elapsed time in either seconds, milliseconds, microseconds or nanoseconds.
Interval(IntervalUnit)
Tuple Fields
0: IntervalUnit
A “calendar” interval which models types that don’t necessarily have a precise duration without the context of a base timestamp (e.g. days can differ in length during day light savings time transitions).
Binary
Opaque binary data of variable length.
FixedSizeBinary(i32)
Tuple Fields
0: i32
Opaque binary data of fixed size. Enum parameter specifies the number of bytes per value.
LargeBinary
Opaque binary data of variable length and 64-bit offsets.
Utf8
A variable-length string in Unicode with UTF-8 encoding.
LargeUtf8
A variable-length string in Unicode with UFT-8 encoding and 64-bit offsets.
List(Box<Field>)
A list of some logical data type with variable length.
FixedSizeList(Box<Field>, i32)
A list of some logical data type with fixed length.
LargeList(Box<Field>)
A list of some logical data type with variable length and 64-bit offsets.
Struct(Vec<Field>)
A nested datatype that contains a number of sub-fields.
Union(Vec<Field>)
A nested datatype that can represent slots of differing types.
Dictionary(Box<DataType>, Box<DataType>)
A dictionary encoded array (key_type
, value_type
), where
each array element is an index of key_type
into an
associated dictionary of value_type
.
Dictionary arrays are used to store columns of value_type
that contain many repeated values using less memory, but with
a higher CPU overhead for some operations.
This type mostly used to represent low cardinality string arrays or a limited set of primitive types as integers.
Decimal(usize, usize)
Decimal value with precision and scale
Map(Box<Field>, bool)
A Map is a logical nested type that is represented as
List<entries: Struct<key: K, value: V>>
The keys and values are each respectively contiguous.
The key and value types are not constrained, but keys should be
hashable and unique.
Whether the keys are sorted can be set in the bool
after the Field
.
In a field with Map type, the field has a child Struct field, which then has two children: key type and the second the value type. The names of the child fields may be respectively “entries”, “key”, and “value”, but this is not enforced.
Implementations
Returns true if this type is numeric: (UInt*, Unit*, or Float*).
Returns true if this type is valid as a dictionary key
(e.g. super::ArrowDictionaryKeyType
Trait Implementations
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error> where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error> where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
This method returns an ordering between self
and other
values if one exists. Read more
This method tests less than (for self
and other
) and is used by the <
operator. Read more
This method tests less than or equal to (for self
and other
) and is used by the <=
operator. Read more
This method tests greater than (for self
and other
) and is used by the >
operator. Read more
See https://arrow.apache.org/docs/format/CDataInterface.html#data-type-description-format-strings
type Error = ArrowError
type Error = ArrowError
The type returned in the event of a conversion error.
Auto Trait Implementations
impl RefUnwindSafe for DataType
impl UnwindSafe for DataType
Blanket Implementations
Mutably borrows from an owned value. Read more
Compare self to key
and return true
if they are equal.