Struct ParallelExecutor 

pub struct ParallelExecutor { /* private fields */ }

Parallel executor that runs independent cells concurrently.

Cells are grouped by dependency level and executed in parallel within each level. Levels are processed sequentially to maintain dependency ordering.

Implementations

impl ParallelExecutor

pub fn new(state_dir: impl AsRef<Path>) -> Result<Self>

Create a new parallel executor.

pub fn with_state(state: StateManager) -> Self

Create with an existing state manager.

pub fn set_callback(&mut self, callback: impl ExecutionCallback + 'static)

Set the execution callback.

pub fn load_cell(&self, compiled: CompiledCell, dep_count: usize) -> Result<()>

Load a compiled cell for execution.

pub fn unload_cell(&self, cell_id: CellId) -> Result<Option<LoadedCell>>

Unload a cell.

pub fn execute_parallel( &self, levels: &[Vec<CellId>], deps: &HashMap<CellId, Vec<CellId>>, ) -> Result<()>

Execute cells in parallel based on dependency levels.

Arguments

• levels - Cells grouped by dependency level (earlier levels have no deps on later ones)
• deps - Dependency map: cell_id -> list of dependency cell_ids

pub fn inner(&self) -> &Arc<Mutex<LinearExecutor>>

Get access to the inner executor.

pub fn flush(&self) -> Result<()>

Flush all cached outputs to disk.