Struct Dqn 

pub struct Dqn<E, Q, R>
where
    Q: SubModel<Output = Tensor>,
    Q::Config: DeserializeOwned + Serialize + OutDim + Debug + PartialEq + Clone,
{ /* private fields */ }

DQN agent implemented with tch-rs.

Trait Implementations

impl<E, Q, R> Agent<E, R> for Dqn<E, Q, R>

where E: Env + 'static, Q: SubModel<Output = Tensor> + 'static, R: ReplayBufferBase + 'static, E::Obs: Into<Q::Input>, E::Act: From<Q::Output>, Q::Config: DeserializeOwned + Serialize + OutDim + Debug + PartialEq + Clone, R::Batch: TransitionBatch, <R::Batch as TransitionBatch>::ObsBatch: Into<Q::Input>, <R::Batch as TransitionBatch>::ActBatch: Into<Tensor>,

fn save_params(&self, path: &Path) -> Result<Vec<PathBuf>>

Save model parameters in the given directory.

The parameters of the model are saved as qnet.pt. The parameters of the target model are saved as qnet_tgt.pt.

fn train(&mut self)

Switches the agent to training mode.

fn eval(&mut self)

Switches the agent to evaluation mode.

fn is_train(&self) -> bool

Returns whether the agent is currently in training mode.

fn opt(&mut self, buffer: &mut R)

Performs a single optimization step using experiences from the replay buffer.

fn opt_with_record(&mut self, buffer: &mut R) -> Record

Performs an optimization step and returns training metrics.

fn load_params(&mut self, path: &Path) -> Result<()>

Loads the agent’s parameters from the specified directory.

fn as_any_mut(&mut self) -> &mut dyn Any

Returns a mutable reference to the agent as a type-erased Any value.

fn as_any_ref(&self) -> &dyn Any

Returns a reference to the agent as a type-erased Any value.

impl<E, Q, R> Configurable for Dqn<E, Q, R>

where E: Env, Q: SubModel<Output = Tensor>, E::Obs: Into<Q::Input>, E::Act: From<Q::Output>, Q::Config: DeserializeOwned + Serialize + OutDim + Debug + PartialEq + Clone,

fn build(config: Self::Config) -> Self

Constructs DQN agent.

type Config = DqnConfig<Q>

The configuration type for this object.

fn build_from_path(path: impl AsRef<Path>) -> Result<Self, Error>

where Self: Sized,

Builds a new instance from a YAML configuration file.

impl<E, Q, R> Policy<E> for Dqn<E, Q, R>

where E: Env, Q: SubModel<Output = Tensor>, E::Obs: Into<Q::Input>, E::Act: From<Q::Output>, Q::Config: DeserializeOwned + Serialize + OutDim + Debug + PartialEq + Clone,

fn sample(&mut self, obs: &E::Obs) -> E::Act

Samples an action given an observation from the environment.