Expand description
Remote worker for distributed pipeline execution.
Receives execution plans from a coordinator, runs them locally,
and reports results. Each worker manages isolated Python environments
(EnvManager) and communicates via WebSocket (protocol).
Re-exports§
pub use coordinator::WorkerRegistry;pub use coordinator::WorkerStatus;pub use coordinator_server::coordinator_router;pub use coordinator_server::serve_coordinator;pub use detect::ResourceLimits;pub use env_manager::EnvManager;pub use remote_executor::WsRemoteExecutor;pub use server::serve_worker;pub use server::serve_worker_authenticated;pub use server::worker_router;pub use server::worker_router_authenticated;pub use worker::Worker;pub use protocol::*;
Modules§
- coordinator
- Coordinator — lightweight gateway that manages worker registration, routing, and health monitoring.
- coordinator_
server - HTTP/WebSocket server for the Coordinator.
- detect
- Auto-detection of hardware capabilities and resource limiting.
- env_
manager - Python environment manager: creates and maintains isolated venvs/conda envs per pipeline, with incremental dependency updates.
- protocol
- Wire protocol for coordinator ↔ worker communication.
- remote_
executor - WebSocket-based RemoteExecutor — sends plans to workers and collects results.
- server
- Axum HTTP/WebSocket server for the worker process.
- worker
- Worker — receives and executes plans from a coordinator.