delta-arrow-reader 0.5.0

Read-only Delta Lake to Apache Arrow reader
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59

site_name: Delta Arrow Reader
site_url: https://mag1cfrog.github.io/delta-arrow-reader/
site_description: Read Delta Lake tables as Apache Arrow streams or DataFusion tables.
repo_name: mag1cfrog/delta-arrow-reader
repo_url: https://github.com/mag1cfrog/delta-arrow-reader
docs_dir: content
site_dir: .site

theme:
  name: material
  variant: modern
  features:
    - navigation.sections
    - content.code.copy
    - search.suggest
    - search.highlight

plugins:
  - search

markdown_extensions:
  - admonition
  - pymdownx.details
  - pymdownx.superfences
  - pymdownx.inlinehilite
  - pymdownx.highlight:
      anchor_linenums: true
      extend_pygments_lang:
        - name: no_run
          lang: rust
        - name: ignore
          lang: rust

nav:
  - Start here:
      - Overview: index.md
      - Installation: installation.md
      - Streaming reader quickstart: streaming-reader.md
      - DataFusion quickstart: datafusion.md
  - How it works:
      - Architecture: architecture.md
      - Delta metadata lifecycle: delta-metadata-lifecycle.md
      - Scan planning: scan-planning.md
      - Read scheduling: read-scheduling.md
  - Performance:
      - Reader benchmarks: benchmarks.md
      - Focused benchmarks:
          - Lazy and eager scan metadata: benchmarks/eager-metadata.md
          - Parquet row-filter predicate decoding: benchmarks/row-filter.md
          - Parquet page-index range reads: benchmarks/page-index.md
          - Adaptive Parquet range planning: benchmarks/range-planning.md
  - Reference:
      - Execution options: reference/execution-options.md
      - Scan metrics: reference/metrics.md
      - Rust API: https://docs.rs/delta-arrow-reader
  - Contributors:
      - Development: contributing.md
      - Extraction parity: benchmark-parity.md
      - Provenance: provenance.md