Module processing_context 

Processing Context Entity

The ProcessingContext entity maintains runtime state and context information throughout pipeline execution. It serves as a central repository for tracking processing progress, configuration parameters, and execution metadata.

Overview

The processing context acts as a stateful carrier object that:

• Tracks Progress: Monitors bytes processed and completion status
• Manages Configuration: Maintains processing parameters and settings
• Collects Metrics: Aggregates performance and operational data
• Stores Metadata: Preserves stage-specific results and information
• Enforces Security: Maintains security context throughout processing

Entity Characteristics

• Mutable State: Tracks changing values during processing
• Unique Identity: Each context has a distinct ProcessingContextId
• Thread Safety: Designed for safe concurrent access patterns
• Serializable: Can be persisted and restored for long-running operations

State Management

The context maintains several categories of state:

Chunk Processing State

• Total file size and bytes processed (for progress tracking)
• Progress calculation and completion status

Configuration State

• Chunk size for processing operations
• Worker count for parallel processing
• Security context and permissions

Runtime State

• Processing metrics and performance data
• Stage-specific results and outputs
• Custom metadata and annotations

Structs

ProcessingContext

Processing context entity that maintains runtime state during pipeline execution.