border-core 0.0.8

Core functionality for Border
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29

//! Generic implementation of replay buffers for reinforcement learning.
//!
//! This module provides a flexible and efficient implementation of replay buffers
//! that can handle arbitrary observation and action types. It supports both
//! standard experience replay and prioritized experience replay (PER).
//!
//! # Key Components
//!
//! - [`SimpleReplayBuffer`]: A generic replay buffer implementation
//! - [`GenericTransitionBatch`]: A generic batch structure for transitions
//! - [`SimpleStepProcessor`]: A processor for converting environment steps to transitions
//! - [`PerConfig`]: Configuration for prioritized experience replay
//!
//! # Features
//!
//! - Generic type support for observations and actions
//! - Efficient batch processing
//! - Prioritized experience replay with importance sampling
//! - Configurable weight normalization
//! - Step processing for non-vectorized environments

mod base;
mod batch;
mod config;
mod step_proc;
pub use base::{IwScheduler, SimpleReplayBuffer, WeightNormalizer};
pub use batch::{BatchBase, GenericTransitionBatch};
pub use config::{PerConfig, SimpleReplayBufferConfig};
pub use step_proc::{SimpleStepProcessor, SimpleStepProcessorConfig};