Expand description
Distributed processing for multi-node transformations Distributed processing scaffolding for transformation pipelines
This module provides the data structures, task model, and async control flow for distributing transformation work across worker nodes.
Current execution model: no HTTP/RPC transport is bundled, so dispatched tasks are executed in-process on the caller (the per-task computation is real and correct). The node/transport plumbing is present so a concrete network backend can be wired in later; until then this behaves as a faithful single-process executor and does not claim or simulate true multi-node distribution.
Structs§
- Auto
Scaling Config - Auto-scaling configuration
- Circuit
Breaker - Circuit breaker for fault tolerance
- Cluster
Health Summary - Cluster health summary
- Distributed
Config - Configuration for distributed processing
- Distributed
Coordinator - Distributed transformation coordinator
- DistributedPCA
- Distributed PCA implementation
- Enhanced
Distributed Coordinator - Enhanced distributed coordinator with fault tolerance and auto-scaling
- Node
Health - Enhanced node health monitoring and status
- Node
Info - Information about a worker node
- Task
Result - Result of a distributed task
Enums§
- Distributed
Task - Represents a distributed transformation task
- Node
Status - Node status enumeration
- Partitioning
Strategy - Strategy for partitioning data across nodes