Struct ContinuousReplayBuffer 

pub struct ContinuousReplayBuffer { /* private fields */ }

Fixed-capacity FIFO replay buffer for off-policy continuous-action training.

Stores (obs, action, reward, next_obs, done) transitions with continuous Vec<f32> actions of width action_dim, and supports uniform random sampling via super::continuous_sampling::sample. The buffer is allocated once at construction (vec![0.0; capacity * obs_dim] etc.); no further allocations occur during push.

This is the continuous-action sibling of ReplayBuffer; the discrete DQN buffer is left untouched.

Implementations

impl ContinuousReplayBuffer

pub fn new(capacity: usize, obs_dim: usize, action_dim: usize) -> Self

Create a new continuous replay buffer with the given capacity, observation dimensionality, and action dimensionality.

Arguments

• capacity - Maximum number of transitions stored. Must be > 0.
• obs_dim - Length of one observation vector. Must be > 0.
• action_dim - Length of one action vector. Must be > 0.

Panics

Panics if capacity == 0, obs_dim == 0, or action_dim == 0.

pub fn push( &mut self, obs: &[f32], action: &[f32], reward: f32, next_obs: &[f32], done: bool, )

Push a single transition into the buffer.

When the buffer is at capacity, this overwrites the oldest transition (FIFO eviction).

Arguments

• obs - Current observation; must have length obs_dim.
• action - Continuous action taken; must have length action_dim.
• reward - Reward received.
• next_obs - Resulting observation; must have length obs_dim.
• done - true if the episode terminated (used to mask the bootstrap term in the TD target).

Panics

Panics in debug builds if obs.len() != obs_dim, next_obs.len() != obs_dim, or action.len() != action_dim.

pub fn len(&self) -> usize

Number of transitions currently in the buffer.

pub fn is_empty(&self) -> bool

true if the buffer holds no transitions.

pub fn capacity(&self) -> usize

Maximum number of transitions the buffer can hold.

pub fn obs_dim(&self) -> usize

Observation dimension (length of one obs slice).

pub fn action_dim(&self) -> usize

Action dimension (length of one action slice).

pub fn is_ready(&self, min_size: usize) -> bool

true if the buffer holds at least min_size transitions.

Used by the trainer to decide whether to start sampling / performing gradient updates: SAC normally collects a few thousand transitions before the first update.

Trait Implementations

impl Clone for ContinuousReplayBuffer

fn clone(&self) -> ContinuousReplayBuffer

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ContinuousReplayBuffer

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.