Module distributed 

DistributedBrick: Work-stealing and data locality (PROBAR-SPEC-009-P10)

This module enables distributed brick execution with:

• Work-stealing across nodes
• Data locality awareness
• Multi-backend dispatch (CPU/GPU/Remote/SIMD)

Architecture

┌─────────────────────────────────────────────────────────────┐
│                   DISTRIBUTED BRICK FLOW                     │
├─────────────────────────────────────────────────────────────┤
│                                                              │
│  1. DistributedBrick<B> wraps any Brick                     │
│  2. BrickDataTracker tracks data locality                   │
│  3. MultiBrickExecutor selects best backend                 │
│  4. BrickCoordinator handles PUB/SUB coordination           │
│                                                              │
└─────────────────────────────────────────────────────────────┘

References

• PROBAR-SPEC-009-P10: Distribution - Repartir Integration

Structs

BackendSelector

Backend selector for choosing optimal execution backend

BrickCoordinator

PUB/SUB coordinator for brick communication

BrickDataTracker

Track where brick weights/data reside across workers

BrickInput

Input data for brick execution

BrickOutput

Output data from brick execution

DataLocation

Data location entry for a specific piece of data

DistributedBrick

Distributed brick wrapper for multi-backend execution

ExecutionMetrics

Metrics from brick execution

MultiBrickExecutor

Multi-backend executor for brick operations

SchedulerStats

Scheduler-wide statistics

Subscription

Subscription to brick events

TaskSpec

Task specification for distributed execution

WorkStealingScheduler

Work-stealing scheduler for distributed brick execution

WorkStealingTask

A task that can be executed by workers and potentially stolen

WorkerId

Unique identifier for a worker node

WorkerQueue

Per-worker task queue supporting work-stealing

WorkerStats

Statistics for a single worker

Enums

Backend

Execution backend for brick operations

BrickMessage

Message for PUB/SUB coordination