Enum EpisodeStatus 

pub enum EpisodeStatus {
    Running,
    Terminated,
    Truncated,
}

Describes the lifecycle status of an episode at a given step.

Separating Terminated from Truncated allows RL algorithms to correctly bootstrap the value function: a truncated episode still has future value, whereas a terminated one does not.

Variants

Running

The episode is still in progress.

Terminated

The episode ended by reaching a terminal MDP state (goal, failure, etc.).

Truncated

The episode ended because an external step limit was reached.

Implementations

impl EpisodeStatus

pub const fn is_done(self) -> bool

true when the episode loop should stop (Terminated or Truncated).

pub const fn is_terminated(self) -> bool

true only for intrinsic MDP termination.

pub const fn is_truncated(self) -> bool

true only for extrinsic step-limit truncation.

Trait Implementations

impl Clone for EpisodeStatus

fn clone(&self) -> EpisodeStatus

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Copy for EpisodeStatus

impl Debug for EpisodeStatus

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Eq for EpisodeStatus

impl PartialEq for EpisodeStatus

fn eq(&self, other: &EpisodeStatus) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for EpisodeStatus