Struct SimpleBandit 

pub struct SimpleBandit { /* private fields */ }

Simple contextual bandit for testing PPO correctness.

Snapshot semantics

clone_state / restore_state capture the current context and step counter, so the next step(action) produces the same reward and terminated flag it would have at snapshot time. The bandit’s internal StdRng is not captured: the next state sampled inside step will differ between the snapshotted run and the restored run, so the observation returned by step is not reproduced bit-for-bit. The reward for the action taken at the snapshot point is still deterministic.

Implementations

impl SimpleBandit

pub fn new() -> Self

Create a new simple bandit environment

Trait Implementations

impl Debug for SimpleBandit

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for SimpleBandit

fn default() -> Self

Returns the “default value” for a type.

impl Environment for SimpleBandit

type Action = i64

Action type accepted by Environment::step.

type State = SimpleBanditState

Snapshot type for this env. For fully deterministic envs without internal RNG, this is the complete env state and restore_state reproduces every subsequent step exactly. For envs that consume an internal RNG (e.g. ball serve direction, food placement), the snapshot captures the simulation step but not the RNG; see the env-level documentation for which fields are preserved.

fn reset(&mut self)

Reset the environment and return initial observation

fn get_observation(&self) -> Vec<f32>

Get the current observation

fn step(&mut self, action: i64) -> StepResult

Step the environment with an action

fn observation_space(&self) -> SpaceInfo

Get the observation space dimensions

fn action_space(&self) -> SpaceInfo

Get the action space dimensions

fn render(&self) -> Vec<u8>

Render the current environment state

fn close(&mut self)

Close the environment

fn clone_state(&self) -> SimpleBanditState

Snapshot the current env state for later restoration.

fn restore_state(&mut self, state: &SimpleBanditState)

Restore the env to a previously-snapshotted state.