orc-rust 0.1.0

Yet another unofficial implementation of Apache ORC spec in safe Rust
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45

# ORC-RS

[![test](https://github.com/wenyxu/orc-rs/actions/workflows/ci.yml/badge.svg)](https://github.com/wenyxu/orc-rs/actions/workflows/ci.yml)
[![codecov](https://codecov.io/gh/WenyXu/orc-rs/branch/main/graph/badge.svg?token=2CSHZX02XM)](https://codecov.io/gh/WenyXu/orc-rs)

Read [Apache ORC](https://orc.apache.org/) in Rust.

* Read ORC files
* Read stripes (the conversion from proto metadata to memory regions)
* Decode stripes (the math of decode stripes into e.g. booleans, runs of RLE, etc.)
* Decode ORC data to [Arrow Datatypes](https://docs.rs/arrow/latest/arrow/datatypes/enum.DataType.html)

## Current Support

| Column Encoding           | Read | Write | Rust Type             | Arrow  DataType         |
| ------------------------- | ---- | ----- | --------------------- | ----------------------- |
| SmallInt, Int, BigInt     | ✓    |       | i16,i32,i64           | Int16, Int32, Int64     |
| Float, Double             | ✓    |       | f32, f64              | Float32, Float64        |
| String, Char, and VarChar | ✓    |       | string                | LargeUtf8               |
| Boolean                   | ✓    |       | bool                  | Boolean                 |
| TinyInt                   | ✗    |       |                       |                         |
| Binary                    | ✗    |       |                       |                         |
| Decimal                   | ✗    |       |                       |                         |
| Date                      | ✓    |       | chrono::NavieDate     | Date32                  |
| Timestamp                 | ✓    |       | chrono::NavieDateTime | Timestamp(Nanosecond,_) |
| Struct                    | ✗    |       |                       |                         |
| List                      | ✗    |       |                       |                         |
| Map                       | ✗    |       |                       |                         |
| Union                     | ✗    |       |                       |                         |


## Compression Support

| Compression | Support |
| ----------- | ------- |
| None        | ✓       |
| ZLIB        | ✓       |
| SNAPPY      | ✗       |
| LZO         | ✗       |
| LZ4         | ✗       |
| ZSTD        | ✗       |