NaturalGradient

Struct NaturalGradient 

Source
pub struct NaturalGradient { /* private fields */ }
Expand description

Natural gradient optimizer using Fisher information matrix.

Accounts for the geometry of the parameter space, which is particularly important for variational quantum circuits.

§Update Rule

$$\theta_{t+1} = \theta_t - \alpha F^{-1} \nabla L$$

where F is the Fisher information matrix.

Implementations§

Source§

impl NaturalGradient

Source

pub fn new(learning_rate: f64) -> Self

Create a new natural gradient optimizer.

Source

pub fn with_regularization(self, reg: f64) -> Self

Set regularization for Fisher matrix inversion.

Source

pub fn compute_natural_gradient( &self, fisher: &Array2<f64>, gradient: &[f64], ) -> Result<Vec<f64>, OptimizerError>

Compute natural gradient given Fisher matrix and gradient.

Trait Implementations§

Source§

impl Optimizer for NaturalGradient

Source§

fn step( &self, params: &mut [f64], gradients: &[f64], _iteration: usize, ) -> Result<(), OptimizerError>

Perform a single optimization step. Read more
Source§

fn name(&self) -> &str

Get the optimizer name.
Source§

fn reset(&mut self)

Reset internal state (for optimizers with momentum).
Source§

fn current_learning_rate(&self, _iteration: usize) -> f64

Get current learning rate (may be adaptive).

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V