Module processing_metrics

adaptive_pipeline_domain::entities

Module processing_metrics 

Source
Expand description

§Processing Metrics Entities

This module contains entities for collecting, tracking, and analyzing performance metrics during pipeline processing operations. The metrics system provides detailed insights into processing performance, resource utilization, and operational health.

§Overview

The metrics system captures:

  • Performance Data: Throughput, processing times, and completion rates
  • Resource Usage: Memory consumption, CPU utilization, and I/O statistics
  • Operational Health: Error rates, success rates, and warning counts
  • Stage-Specific Metrics: Individual performance data for each pipeline stage
  • File Processing Stats: Input/output file sizes, checksums, and compression ratios

§Metrics Architecture

§High-Resolution Timing

Uses std::time::Instant for precise internal timing measurements while providing RFC3339 timestamps for serialization and external reporting.

§Hierarchical Structure

  • ProcessingMetrics: Overall pipeline processing metrics
  • StageMetrics: Individual stage performance metrics

§Real-Time Calculation

Metrics are calculated and updated in real-time as processing progresses, providing immediate feedback on performance characteristics.

Structs§

ProcessingMetrics
Processing metrics entity for comprehensive performance tracking and analysis.
StageMetrics
Stage-specific metrics entity for detailed performance analysis.