delta-arrow-reader 0.4.0

Read-only Delta Lake to Apache Arrow reader
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48

# Installation

Delta Arrow Reader requires Rust 1.94 or newer. The dependencies you need
depend on whether you want an Arrow stream or a DataFusion table.

## Streaming reader

For streaming Arrow batches, add the reader, Tokio, and the futures utilities used
by the quickstart:

```toml
[dependencies]
delta-arrow-reader = "0.3.0"
futures-util = "0.3"
tokio = { version = "1", features = ["macros", "rt-multi-thread"] }
```

You can now continue to the [streaming reader quickstart](https://mag1cfrog.github.io/delta-arrow-reader/streaming-reader/).

## DataFusion adapter

For SQL queries, enable the reader's `datafusion` feature and add the matching
DataFusion release:

```toml
[dependencies]
datafusion = { version = "54.1.0", default-features = false, features = ["sql"] }
delta-arrow-reader = { version = "0.3.0", features = ["datafusion"] }
tokio = { version = "1", features = ["macros", "rt-multi-thread"] }
```

You can now continue to the [DataFusion quickstart](https://mag1cfrog.github.io/delta-arrow-reader/datafusion/).

## Optional feature

The streaming API and both Parquet backends are always available. The
only optional feature adds the DataFusion integration.

| Feature | Default | Purpose |
| --- | --- | --- |
| `datafusion` | No | Register Delta tables with DataFusion and expose execution metrics. |

The direct Parquet backend is selected by default. Rust callers can choose the
Delta Kernel backend through `DeltaScanExecutionOptions` without changing
Cargo features.

Both APIs run on your application's Tokio runtime. Delta Arrow Reader does not
create a separate runtime.