Struct ReplayBufferProxy

pub struct ReplayBufferProxy<R: ExperienceBufferBase> { /* private fields */ }

A wrapper of replay buffer for asynchronous trainer.

Implementations

impl<R: ExperienceBufferBase> ReplayBufferProxy<R>

pub fn build_with_sender( id: usize, config: &ReplayBufferProxyConfig, sender: Sender<PushedItemMessage<R::Item>>, ) -> Self

Trait Implementations

impl<R: ExperienceBufferBase> ExperienceBufferBase for ReplayBufferProxy<R>

type Item = <R as ExperienceBufferBase>::Item

The type of items stored in the buffer.

fn push(&mut self, tr: Self::Item) -> Result<()>

Pushes a new experience into the buffer.

fn len(&self) -> usize

Returns the current number of experiences in the buffer.

impl<R: ExperienceBufferBase + ReplayBufferBase> ReplayBufferBase for ReplayBufferProxy<R>

type Config = ReplayBufferProxyConfig

Configuration parameters for the replay buffer.

type Batch = <R as ReplayBufferBase>::Batch

The type of batch generated for training.

fn build(_config: &Self::Config) -> Self

Builds a new replay buffer from the given configuration.

fn batch(&mut self, _size: usize) -> Result<Self::Batch>

Constructs a batch of experiences for training.

fn update_priority( &mut self, _ixs: &Option<Vec<usize>>, _td_err: &Option<Vec<f32>>, )

Updates the priorities of experiences in the buffer.