Expand description
Direct DataFusion integration for an existing Vortex
DataSourceRef.
Use this module when some other part of the system has already selected the Vortex source to query and DataFusion only needs an adapter around it.
Typical flow:
- Build or obtain a Vortex
DataSourceRef. - Wrap it in
VortexTableto register it with aSessionContext, or build aVortexDataSourcedirectly when constructing aDataSourceExec. - Let DataFusion apply projection, filter, and limit pushdown through the resulting adapter.
The two main types are:
VortexTable, the higher-levelTableProviderforSessionContext::register_table.VortexDataSource, the lower-levelDataSourceused when constructing physical plans directly.
Compared with crate::VortexFormatFactory, this module starts from an
already-constructed Vortex source instead of asking DataFusion to discover
.vortex files.
Structsยง
- Vortex
Data Source - DataFusion
DataSourcebacked by a VortexDataSourceRef. - Vortex
Table - DataFusion
TableProviderbacked by a VortexDataSourceRef.