Trait border_core::StdBatchBase

source ·

pub trait StdBatchBase {
    type ObsBatch;
    type ActBatch;

    // Required methods
    fn unpack(
        self
    ) -> (Self::ObsBatch, Self::ActBatch, Self::ObsBatch, Vec<f32>, Vec<i8>, Option<Vec<usize>>, Option<Vec<f32>>);
    fn len(&self) -> usize;
    fn obs(&self) -> &Self::ObsBatch;
    fn act(&self) -> &Self::ActBatch;
    fn next_obs(&self) -> &Self::ObsBatch;
    fn reward(&self) -> &Vec<f32>;
    fn is_done(&self) -> &Vec<i8>;
    fn weight(&self) -> &Option<Vec<f32>>;
    fn ix_sample(&self) -> &Option<Vec<usize>>;
    fn empty() -> Self;
}

Expand description

A batch of transitions for training agents.

This trait represents a standard transition (o, a, o', r, is_done), where o is an observation, a is an action, o' is an observation after some time steps. Typically, o' is for the next step and used as single-step backup. o' can also be for the multiple steps after o and in this case it is sometimes called n-step backup.

The type of o and o' is the associated type ObsBatch. The type of a is the associated type ActBatch.