Struct PrioritizedReplayBuffer 

pub struct PrioritizedReplayBuffer { /* private fields */ }

Prioritized Experience Replay buffer with proportional priority and IS weights.

Implementations

impl PrioritizedReplayBuffer

pub fn new( capacity: usize, obs_dim: usize, act_dim: usize, alpha: f64, beta_start: f64, ) -> Self

Create a PER buffer.

• capacity — maximum number of transitions.
• obs_dim, act_dim — observation / action dimensions.
• alpha — priority exponent (default 0.6).
• beta_start — initial IS exponent (default 0.4, annealed to 1).

pub fn push( &mut self, obs: impl AsRef<[f32]>, action: impl AsRef<[f32]>, reward: f32, next_obs: impl AsRef<[f32]>, done: bool, )

Push a transition with maximum priority (so it will be sampled at least once).

pub fn update_priority(&mut self, index: usize, priority: f64)

Update priority for a transition that was previously sampled.

Arguments

• index — the buffer index returned in PrioritySample::index.
• priority — new absolute priority (typically |TD error| + ε).

pub fn set_beta(&mut self, beta: f64)

Set the current β for IS weight computation.

pub fn anneal_beta(&mut self, step: f64)

Anneal β toward 1 by step (additive).

pub fn len(&self) -> usize

Number of stored transitions.

pub fn is_empty(&self) -> bool

Returns true if empty.

pub fn sample( &self, batch_size: usize, handle: &mut RlHandle, ) -> RlResult<Vec<PrioritySample>>

Sample batch_size transitions using stratified proportional sampling.

Stratified: the [0, total_priority] interval is divided into batch_size equal strata and one sample is drawn uniformly from each stratum. This reduces variance compared to fully random sampling.

Errors

• RlError::InsufficientTransitions if size < batch_size.
• RlError::ZeroPrioritySum if all priorities are zero.

Trait Implementations

impl Clone for PrioritizedReplayBuffer

fn clone(&self) -> PrioritizedReplayBuffer

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for PrioritizedReplayBuffer

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.