Expand description
Execution plan for reading Arrow IPC files
§Naming Note
The naming in this module can be confusing:
ArrowFileOpenerhandles the Arrow IPC file format (with footer, supports parallel reading)ArrowStreamFileOpenerhandles the Arrow IPC stream format (without footer, sequential only)ArrowSourceis the unifiedFileSourceimplementation that uses either opener depending on the format specified at construction
Despite the name “ArrowStreamFileOpener”, it still reads from files - the “Stream” refers to the Arrow IPC stream format, not streaming I/O. Both formats can be stored in files on disk or object storage.
Structs§
- Arrow
Opener FileOpenerwrapper for both Arrow IPC file and stream formats- Arrow
Source FileSourcefor both Arrow IPC file and stream formats