Struct Sampler

pub struct Sampler<E, P>
where
    E: Env,
    P: StepProcessor<E>,
{ /* private fields */ }

Manages the sampling of experiences from the environment.

This struct handles the interaction between the agent and environment, processes the resulting experiences, and stores them in a replay buffer. It also tracks various metrics about the sampling process.

Type Parameters

• E - The environment type
• P - The step processor type

Implementations

impl<E, P> Sampler<E, P>

where E: Env, P: StepProcessor<E>,

pub fn new(env: E, step_processor: P) -> Self

Creates a new sampler with the given environment and step processor.

Arguments

• env - The environment to sample from
• step_processor - The processor for converting steps into transitions

Returns

A new Sampler instance

pub fn sample_and_push<R, R_>( &mut self, agent: &mut Box<dyn Agent<E, R>>, buffer: &mut R_, ) -> Result<Record>

where R: ExperienceBufferBase<Item = P::Output> + ReplayBufferBase, R_: ExperienceBufferBase<Item = R::Item>,

Samples an experience and pushes it to the replay buffer.

This method:

1. Resets the environment if needed
2. Samples an action from the agent
3. Applies the action to the environment
4. Processes the resulting step
5. Stores the experience in the replay buffer

Arguments

• agent - The agent to sample actions from
• buffer - The replay buffer to store experiences in

Returns

A Record containing metrics about the sampling process

Errors

Returns an error if:

• The environment fails to reset
• The environment step fails
• The replay buffer operation fails