Module dataflow_debugger

Module dataflow_debugger 

Source
Expand description

Dataflow debugger for DataFrame pipeline debugging (RUCHY-0818)

Provides comprehensive debugging capabilities for DataFrame operations, including breakpoints, materialization on demand, and stage-by-stage analysis.

Structs§

Breakpoint
Breakpoint configuration for pipeline debugging
ColumnDef
Column definition in DataFrame schema
DataRow
Single row of data in materialized DataFrame
DataSchema
DataFrame schema information
DataflowConfig
Configuration for the dataflow debugger
DataflowDebugger
Dataflow debugger for DataFrame pipeline analysis
DebugExport
Complete debugging data export structure
ExecutionEvent
Execution event in the debugging session
MaterializedFrame
Materialized DataFrame data for inspection
PipelineStage
Individual stage in the DataFrame pipeline
SessionState
Current state of the debugging session
StageDiff
Diff between two pipeline stages
StageMetrics
Performance metrics for a pipeline stage

Enums§

BreakpointAction
Actions to perform when breakpoint is triggered
BreakpointCondition
Conditions for triggering breakpoints
ColumnChange
Types of column changes between stages
ComparisonOp
Comparison operators for breakpoint conditions
DataChange
Types of data changes between stages
DataType
Supported data types in DataFrames
DataValue
Individual data value in a DataFrame cell
EventType
Types of execution events
ExportFormat
Export formats for dataflow debugging data
StageExecutionResult
Result of executing a pipeline stage
StageStatus
Execution status of a pipeline stage
StageType
Types of DataFrame operations