DataFusion Federation
The goal of this repo is to allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.
Check out the examples to get a feel for how it works.
Potential use-cases:
- Querying across SQLite, MySQL, PostgreSQL, ...
- Pushing down SQL or Substrait plans.
- DataFusion -> Flight SQL -> DataFusion
- ..
Status
The project is in alpha status. Contributions welcome; land a PR = commit access.