Skip to main content

Module v2

Module v2 

Source
Expand description

Direct DataFusion integration for an existing Vortex DataSourceRef.

Use this module when some other part of the system has already selected the Vortex source to query and DataFusion only needs an adapter around it.

Typical flow:

  1. Build or obtain a Vortex DataSourceRef.
  2. Wrap it in VortexTable to register it with a SessionContext, or build a VortexDataSource directly when constructing a DataSourceExec.
  3. Let DataFusion apply projection, filter, and limit pushdown through the resulting adapter.

The two main types are:

Compared with crate::VortexFormatFactory, this module starts from an already-constructed Vortex source instead of asking DataFusion to discover .vortex files.

Structsยง

VortexDataSource
DataFusion DataSource backed by a Vortex DataSourceRef.
VortexTable
DataFusion TableProvider backed by a Vortex DataSourceRef.