Module workflow

Module workflow 

Source
Expand description

Workflow automation tools

Provides framework for building automated data processing workflows:

  • Task definition and dependency management
  • Workflow scheduling and execution
  • Resource management and allocation
  • Retry policies and error handling
  • Progress monitoring and notifications
  • Common workflow templates (ETL, batch processing) Workflow automation tools for scientific data processing

Provides a framework for building and executing automated data processing workflows with dependency management, scheduling, and monitoring capabilities.

Modules§

distributed
Distributed execution support
dynamic
Dynamic workflow generation
engines
External workflow engine integration
events
Event-driven workflows
monitoring
Workflow monitoring and metrics
scheduling
Advanced scheduling capabilities
tasks
Task builders for common operations
templates
Workflow templates for common patterns
versioning
Workflow versioning and history
visualization
Workflow visualization

Structs§

ExecutorConfig
GpuRequirement
NotificationConfig
Notification configuration
ResourceRequirements
Resource requirements for tasks
RetryPolicy
Retry policy for failed tasks
ScheduleConfig
Schedule configuration for periodic execution
Task
Task definition
TaskState
Workflow
Workflow definition
WorkflowBuilder
Workflow builder
WorkflowConfig
Workflow configuration
WorkflowExecutor
Workflow executor
WorkflowState
Workflow execution state

Enums§

NotificationChannel
TaskStatus
TaskType
Task types
WorkflowStatus