Skip to main content

VortexReaderFactory

vortex_datafusion::reader

Trait VortexReaderFactory 

Source 
pub trait VortexReaderFactory:
    Debug
    + Send
    + Sync
    + 'static {
    // Required method
    fn create_reader(
        &self,
        file: &PartitionedFile,
        session: &VortexSession,
    ) -> DFResult<Arc<dyn VortexReadAt>>;
}
Expand description

Factory to create VortexReadAt instances for a PartitionedFile.

Plug a custom implementation into VortexSource::with_vortex_reader_factory when the default object-store reader is not sufficient, for example to:

  • reuse an application-level metadata cache,
  • wrap reads with custom authentication or routing,
  • coalesce I/O in a remote storage layer.

Required Methods§

Source

fn create_reader( &self, file: &PartitionedFile, session: &VortexSession, ) -> DFResult<Arc<dyn VortexReadAt>>

Create a reader for a target object.

Implementors§