Struct EpsilonInjector 

pub struct EpsilonInjector<T: Inferer, NG: NoiseGenerator = HighQualityNoiseGenerator> { /* private fields */ }

The EpsilonInjector wraps an inferer to add noise values as one of the input data points. This is useful for continuous action policies where you might have trained your agent to follow a stochastic policy trained with the reparametrization trick.

Note that it’s fully possible to pass an epsilon directly in your observation, and this is purely a convenience wrapper.

Implementations

impl<T> EpsilonInjector<T, HighQualityNoiseGenerator>

where T: Inferer,

pub fn wrap( inferer: T, key: &str, ) -> Result<EpsilonInjector<T, HighQualityNoiseGenerator>>

Wraps the provided inferer to automatically generate noise for the input named by key.

This function will use HighQualityNoiseGenerator as the noise source.

Errors

Will return an error if the provided key doesn’t match an input on the model.

impl<T, NG> EpsilonInjector<T, NG>

where T: Inferer, NG: NoiseGenerator,

pub fn with_generator(inferer: T, generator: NG, key: &str) -> Result<Self>

Create a new injector for the provided key, using the custom generator as the noise source.

Errors

Will return an error if the provided key doesn’t match an input on the model.

Trait Implementations

impl<T, NG> Inferer for EpsilonInjector<T, NG>

where T: Inferer, NG: NoiseGenerator,

fn select_batch_size(&self, max_count: usize) -> usize

Query the inferer for how many elements it can deal with in a single batch.

fn infer_raw(&self, batch: &mut ScratchPadView<'_>) -> Result<(), Error>

Execute the model on the provided pre-batched data.

fn input_shapes(&self) -> &[(String, Vec<usize>)]

Retrieve the name and shapes of the model inputs. This API only contains the external API, so code-based transforms outside the model are hidden.

fn raw_input_shapes(&self) -> &[(String, Vec<usize>)]

Retrieve the name and shapes of the model inputs.

fn raw_output_shapes(&self) -> &[(String, Vec<usize>)]

Retrieve the name and shapes of the model outputs.

fn begin_agent(&self, id: u64)

fn end_agent(&self, id: u64)

fn output_shapes(&self) -> &[(String, Vec<usize>)]

Retrieve the name and shapes of the model outputs. This API only contains the external API, so code-based transforms outside the model are hidden.