Struct OrcSource 

pub struct OrcSource { /* private fields */ }

Execution plan for reading one or more ORC files.

Supports projection, limit pushdown, and stripe-level predicate pushdown. TODO: Add schema adapter support and column statistics pruning.

Implementations

impl OrcSource

pub fn new(table_schema: impl Into<TableSchema>) -> Self

Create a new OrcSource

pub fn with_read_options(self, read_options: OrcReadOptions) -> Self

Set read options for ORC scans.

pub fn read_options(&self) -> &OrcReadOptions

Return the current read options.

pub fn with_predicate(&self, predicate: Arc<dyn PhysicalExpr>) -> Self

Create a new OrcSource with a predicate filter

The predicate will be converted to an orc-rust Predicate and used for stripe-level filtering during file reads.

pub fn orc_predicate(&self) -> Option<&OrcPredicate>

Get the orc-rust predicate (if conversion was successful)

Trait Implementations

impl Clone for OrcSource

fn clone(&self) -> OrcSource

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for OrcSource

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl FileSource for OrcSource

fn filter(&self) -> Option<Arc<dyn PhysicalExpr>>

Returns the filter expression that will be applied during the file scan.

fn create_file_opener( &self, object_store: Arc<dyn ObjectStore>, base_config: &FileScanConfig, partition: usize, ) -> Arc<dyn FileOpener>

Creates a dyn FileOpener based on given parameters

fn as_any(&self) -> &dyn Any

Any

fn with_batch_size(&self, batch_size: usize) -> Arc<dyn FileSource>

Initialize new type with batch size configuration

fn with_schema(&self, schema: TableSchema) -> Arc<dyn FileSource>

Initialize new instance with a new schema

fn with_projection(&self, _config: &FileScanConfig) -> Arc<dyn FileSource>

Initialize new instance with projection information

fn with_statistics(&self, statistics: Statistics) -> Arc<dyn FileSource>

Initialize new instance with projected statistics

fn statistics(&self) -> Result<Statistics>

Return projected statistics

fn metrics(&self) -> &ExecutionPlanMetricsSet

Return execution plan metrics

fn file_type(&self) -> &str

String representation of file source such as “csv”, “json”, “parquet”

fn fmt_extra(&self, t: DisplayFormatType, f: &mut Formatter<'_>) -> Result

Format FileType specific information

fn try_pushdown_filters( &self, filters: Vec<Arc<dyn PhysicalExpr>>, _config: &ConfigOptions, ) -> Result<FilterPushdownPropagation<Arc<dyn FileSource>>>

Try to push down filters into this FileSource. See ExecutionPlan::handle_child_pushdown_result for more details.

fn repartitioned( &self, target_partitions: usize, repartition_file_min_size: usize, output_ordering: Option<LexOrdering>, config: &FileScanConfig, ) -> Result<Option<FileScanConfig>, DataFusionError>

If supported by the FileSource, redistribute files across partitions according to their size. Allows custom file formats to implement their own repartitioning logic.

fn with_schema_adapter_factory( &self, _factory: Arc<dyn SchemaAdapterFactory>, ) -> Result<Arc<dyn FileSource>, DataFusionError>

Set optional schema adapter factory.

fn schema_adapter_factory(&self) -> Option<Arc<dyn SchemaAdapterFactory>>

Returns the current schema adapter factory if set

impl From<OrcSource> for Arc<dyn FileSource>

Allows easy conversion from OrcSource to Arc

fn from(source: OrcSource) -> Self

Converts to this type from the input type.