Module mapreduce 

MapReduce executor for parallel workflow execution

This module orchestrates parallel execution of workflow steps across multiple agents using isolated git worktrees for fault isolation and parallelism.

The module has been decomposed into focused sub-modules following functional programming principles, with each module under 500 lines for maintainability.

Re-exports

pub use agent::AgentLifecycleManager;

pub use agent::AgentResult;

pub use agent::AgentResultAggregator;

pub use agent::AgentStatus;

pub use aggregation::AggregationSummary;

pub use aggregation::ResultCollector;

pub use aggregation::ResultReducer;

pub use coordination::MapReduceCoordinator;

pub use coordination::PhaseOrchestrator;

pub use coordination::WorkScheduler;

pub use state::StateManager;

pub use types::AgentContext;

pub use types::MapPhase;

pub use types::MapReduceConfig;

pub use types::ReducePhase;

pub use types::ResumeOptions;

pub use types::ResumeResult;

pub use types::SetupPhase;

pub use utils::calculate_map_result_summary;

pub use utils::MapResultSummary;

Modules

agent

Agent module for MapReduce parallel execution

agent_command_executor

Agent command execution module

aggregation

Result aggregation and reduction module

checkpoint

Checkpoint management for MapReduce workflows

checkpoint_integration

Integration of checkpoint management with MapReduce execution

cleanup

Worktree cleanup management for MapReduce jobs

command

Command execution module for MapReduce operations

coordination

Execution coordination for MapReduce operations

dlq_integration

DLQ Integration for MapReduce Agent Failures (Spec 176)

dry_run

Dry-run mode support for MapReduce workflows

effects

Effect-based I/O operations for MapReduce execution

env_interpolation

Pure functions for environment variable interpolation in MapReduce workflows

environment

Environment types for MapReduce effect execution

environment_helpers

Reader pattern helpers for environment access

event

Event tracking for MapReduce execution

map_phase

Map phase execution functionality

merge_queue

Merge queue for serializing agent merges in MapReduce workflows

mock_environment

Mock environment builders for testing

noop_writer

No-op event writer for fallback scenarios

phases

Phase execution module for MapReduce workflows

progress

Progress management module for MapReduce execution

pure

Pure functional utilities for MapReduce execution

reduce_phase

Reduce phase execution functionality

resources

Resource management module for MapReduce executor

resume_collection

Pure functions for collecting work items from various sources in MapReduce resume.

resume_deduplication

Pure functions for deduplicating work items in MapReduce resume operations.

retry_tracking

Retry tracking for MapReduce work items.

state

MapReduce state management module

timeout

Timeout enforcement for MapReduce agents

types

Shared types and traits for MapReduce operations

utils

Pure utility functions for MapReduce operations

validation

Work item validation for MapReduce workflows (Spec 176)

Structs

MapReduceExecutor

Main MapReduce executor that coordinates all operations