Varpulis Cluster

Distributed execution support for Varpulis streaming analytics.

Provides a coordinator-based control plane for deploying and managing pipeline groups across multiple worker processes.

Architecture

• Coordinator: Central control plane that manages worker registration, pipeline placement, event routing, and health monitoring.
• Workers: Standard varpulis server processes that register with a coordinator and run assigned pipelines.
• Pipeline Groups: Collections of related pipelines deployed together with routing rules for inter-pipeline communication.

Usage

# Start coordinator
varpulis coordinator --port 9100 --api-key admin

# Start workers (they auto-register)
varpulis server --port 9000 --api-key test --coordinator http://localhost:9100 --worker-id w0
varpulis server --port 9001 --api-key test --coordinator http://localhost:9100 --worker-id w1