Module metrics

Module metrics 

Source
Expand description

Performance metrics for ORC file operations.

This module provides metrics for monitoring and analyzing ORC file reading performance, including I/O statistics, pruning effectiveness, and timing.

§Metric Categories

  • I/O Metrics: Track bytes scanned and I/O requests
  • Metadata Metrics: Track metadata loading time
  • Stripe Pruning: Track stripe-level filtering effectiveness
  • Predicate Evaluation: Track predicate pushdown statistics

§Example

use datafusion_datasource_orc::metrics::OrcFileMetrics;
use datafusion_physical_plan::metrics::ExecutionPlanMetricsSet;

let metrics_set = ExecutionPlanMetricsSet::new();
let metrics = OrcFileMetrics::new(0, "example.orc", &metrics_set);

// Record bytes scanned
metrics.bytes_scanned.add(1024);

// Record metadata load time
let timer = metrics.metadata_load_time.timer();
// ... load metadata ...
timer.done();

Structs§

OrcFileMetrics
Metrics for ORC file operations.