pub struct RLOptimizerConfig<T: Float + Debug + Send + Sync + 'static> {Show 13 fields
pub policy_lr: T,
pub value_lr: T,
pub discount_factor: T,
pub gae_lambda: T,
pub clip_epsilon: T,
pub entropy_coeff: T,
pub value_loss_coeff: T,
pub max_grad_norm: T,
pub n_epochs: usize,
pub mini_batchsize: usize,
pub trust_region_config: Option<TrustRegionConfig<T>>,
pub use_natural_gradients: bool,
pub fisher_approximation: FisherApproximationMethod,
}Expand description
Reinforcement Learning optimization configuration
Fields§
§policy_lr: TPolicy learning rate
value_lr: TValue function learning rate
discount_factor: TDiscount factor (gamma)
gae_lambda: TGAE lambda parameter
clip_epsilon: TClipping parameter for PPO
entropy_coeff: TEntropy regularization coefficient
value_loss_coeff: TValue function loss coefficient
max_grad_norm: TMaximum gradient norm for clipping
n_epochs: usizeNumber of optimization epochs per update
mini_batchsize: usizeMini-batch size for optimization
trust_region_config: Option<TrustRegionConfig<T>>Trust region methods configuration
use_natural_gradients: boolEnable natural policy gradients
fisher_approximation: FisherApproximationMethodFisher information matrix approximation method
Trait Implementations§
Source§impl<T: Clone + Float + Debug + Send + Sync + 'static> Clone for RLOptimizerConfig<T>
impl<T: Clone + Float + Debug + Send + Sync + 'static> Clone for RLOptimizerConfig<T>
Source§fn clone(&self) -> RLOptimizerConfig<T>
fn clone(&self) -> RLOptimizerConfig<T>
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreAuto Trait Implementations§
impl<T> Freeze for RLOptimizerConfig<T>where
T: Freeze,
impl<T> RefUnwindSafe for RLOptimizerConfig<T>where
T: RefUnwindSafe,
impl<T> Send for RLOptimizerConfig<T>
impl<T> Sync for RLOptimizerConfig<T>
impl<T> Unpin for RLOptimizerConfig<T>where
T: Unpin,
impl<T> UnsafeUnpin for RLOptimizerConfig<T>where
T: UnsafeUnpin,
impl<T> UnwindSafe for RLOptimizerConfig<T>where
T: UnwindSafe,
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§impl<T> Pointable for T
impl<T> Pointable for T
impl<T> Read<Exclusive, BecauseExclusive> for Twhere
T: ?Sized,
Source§impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
impl<SS, SP> SupersetOf<SS> for SPwhere
SS: SubsetOf<SP>,
Source§fn to_subset(&self) -> Option<SS>
fn to_subset(&self) -> Option<SS>
The inverse inclusion map: attempts to construct
self from the equivalent element of its
superset. Read moreSource§fn is_in_subset(&self) -> bool
fn is_in_subset(&self) -> bool
Checks if
self is actually part of its subset T (and can be converted to it).Source§fn to_subset_unchecked(&self) -> SS
fn to_subset_unchecked(&self) -> SS
Use with care! Same as
self.to_subset but without any property checks. Always succeeds.Source§fn from_subset(element: &SS) -> SP
fn from_subset(element: &SS) -> SP
The inclusion map: converts
self to the equivalent element of its superset.