Struct ExecutorManager 

pub struct ExecutorManager { /* private fields */ }

Implementations

impl ExecutorManager

pub async fn init(&self) -> Result<()>

pub async fn bind_schedulable_tasks( &self, active_jobs: Arc<HashMap<String, JobInfoCache>>, ) -> Result<Vec<BoundTask>>

Bind the ready to running tasks from [active_jobs] with available executors.

If executors is provided, only bind slots from the specified executor IDs

pub async fn unbind_tasks( &self, executor_slots: Vec<ExecutorSlot>, ) -> Result<()>

Returned reserved task slots to the pool of available slots. This operation is atomic so either the entire pool of reserved task slots it returned or none are.

pub async fn cancel_running_tasks( &self, tasks: Vec<RunningTaskInfo>, ) -> Result<()>

Send rpc to Executors to cancel the running tasks

pub fn clean_up_job_data(&self, job_id: String)

Send rpc to Executors to clean up the job data in a spawn thread

pub async fn get_executor_state( &self, ) -> Result<Vec<(ExecutorMetadata, Duration)>>

Get a list of all executors along with the timestamp of their last recorded heartbeat

pub async fn get_executor_metadata( &self, executor_id: &str, ) -> Result<ExecutorMetadata>

Get executor metadata for the provided executor ID. Returns an error if the executor does not exist

pub async fn save_executor_metadata( &self, metadata: ExecutorMetadata, ) -> Result<()>

It’s only used for pull-based task scheduling.

For push-based one, we should use [register_executor], instead.

pub async fn register_executor( &self, metadata: ExecutorMetadata, specification: ExecutorData, ) -> Result<()>

Register the executor with the scheduler.

This will save the executor metadata and the executor data to persistent state.

It’s only used for push-based task scheduling

pub async fn remove_executor( &self, executor_id: &str, reason: Option<String>, ) -> Result<()>

Remove the executor from the cluster

pub async fn stop_executor(&self, executor_id: &str, stop_reason: String)

pub async fn launch_multi_task( &self, executor_id: &str, multi_tasks: Vec<MultiTaskDefinition>, scheduler_id: String, ) -> Result<()>

Trait Implementations

impl Clone for ExecutorManager

fn clone(&self) -> ExecutorManager

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.