Struct ActorManager

pub struct ActorManager<A, E, R, P>
where
    A: Agent<E, R> + Configurable + SyncModel,
    E: Env,
    P: StepProcessor<E>,
    R: ExperienceBufferBase<Item = P::Output> + ReplayBufferBase,
{ /* private fields */ }

Manages Actors.

This struct handles the following requests:

• From the AsyncTrainer for updating the latest model info, stored in this struct.
• From the Actors for getting the latest model info.
• From the Actors for pushing sample batch to the LearnerManager.

Implementations

impl<A, E, R, P> ActorManager<A, E, R, P>

where A: Agent<E, R> + Configurable + SyncModel + 'static, E: Env, P: StepProcessor<E>, R: ExperienceBufferBase<Item = P::Output> + Send + 'static + ReplayBufferBase, A::Config: Send + 'static, E::Config: Send + 'static, P::Config: Send + 'static, R::Item: Send + 'static, A::ModelInfo: Send + 'static,

pub fn build( config: &ActorManagerConfig, agent_configs: &Vec<A::Config>, env_config: &E::Config, step_proc_config: &P::Config, pushed_item_message_sender: Sender<PushedItemMessage<R::Item>>, model_info_receiver: Receiver<(usize, A::ModelInfo)>, stop: Arc<Mutex<bool>>, ) -> Self

Builds a ActorManager.

pub fn run(&mut self, guard_init_env: Arc<Mutex<bool>>)

Runs threads for Actors and a thread for sending samples into the replay buffer.

Each thread is blocked until receiving the initial SyncModel::ModelInfo from AsyncTrainer.

pub fn join(self) -> Vec<ActorStat>

Waits until all actors finish.

pub fn stop(&self)

Stops actor threads.

pub fn stop_and_join(self) -> Vec<ActorStat>

Stops and joins actors.