Struct datafusion::test_util::parquet::TestParquetFile

pub struct TestParquetFile { /* private fields */ }

a ParquetFile that has been created for testing.

Implementations

impl TestParquetFile

pub fn try_new( path: PathBuf, props: WriterProperties, batches: impl IntoIterator<Item = RecordBatch> ) -> Result<Self>

Creates a new parquet file at the specified location with the given properties

impl TestParquetFile

pub async fn create_scan( &self, ctx: &SessionContext, maybe_filter: Option<Expr> ) -> Result<Arc<dyn ExecutionPlan>>

Return a ParquetExec with the specified options.

If maybe_filter is non-None, the ParquetExec will be filtered using the given expression, and this method will return the same plan that DataFusion will make with a pushed down predicate followed by a filter:

(FilterExec)
  (ParquetExec)

Otherwise if maybe_filter is None, return just a ParquetExec

pub fn parquet_metrics(plan: Arc<dyn ExecutionPlan>) -> Option<MetricsSet>

Retrieve metrics from the parquet exec returned from create_scan

Recursively searches for ParquetExec and returns the metrics on the first one it finds

pub fn schema(&self) -> SchemaRef

The schema of this parquet file

pub fn path(&self) -> &Path

The path to the parquet file