Expand description
§Distributed Stream Processing
Provides infrastructure for coordinating stream processing across multiple nodes in a cluster. This module implements consistent hashing for partition routing, distributed window aggregation, and cluster-wide job distribution.
§Components
DistributedStreamTopology: Coordinates stream processing across nodesConsistentHashRouter: Routes stream partitions to nodes via consistent hashingDistributedWindowAggregator: Aggregates windowed results across cluster nodesClusterStreamCoordinator: Manages stream job distribution across the cluster
Structs§
- Aggregated
Window Result - Aggregated result across all nodes for a window
- Cluster
Stream Coordinator - Manages stream job distribution across a cluster.
- Consistent
Hash Router - Routes stream partitions to nodes using consistent hashing.
- Coordinator
Stats - Statistics for the cluster coordinator
- Distributed
Stream Topology - Coordinates stream processing across multiple cluster nodes.
- Distributed
Window Aggregator - Aggregates windowed results from multiple cluster nodes.
- Partial
Window Result - A partial window result from a single node
- Stream
Job - A stream processing job that is distributed across cluster nodes
- Stream
Node - Metadata for a node participating in distributed stream processing
- Topology
Config - Configuration for a distributed stream topology
- Topology
Stats - Statistics snapshot for the topology
Enums§
- Distributed
Stream Error - Errors that can occur in distributed stream processing
- Node
Status - Represents the health status of a cluster node
- Topology
Change - A topology change event broadcast on topology changes
Type Aliases§
- Distributed
Result - Result type for distributed stream operations