Skip to main content

NaturalGradientPolicy

Struct NaturalGradientPolicy 

Source
pub struct NaturalGradientPolicy {
    pub temperature_ns: u64,
}
Expand description

Natural-gradient policy for choosing the next autotune probe from measured latency samples.

The policy treats the candidate set as a discrete distribution over launch configurations. Latency samples become a softmax over -elapsed_ns / temperature_ns; the supplied inverse-Fisher square-root matrix preconditions that probability/gradient vector before the driver picks the next candidate. CUDA/self-substrate can produce the same fixed-point matrix through the primitive-backed natural-gradient path.

Fields§

§temperature_ns: u64

Softmax temperature in nanoseconds. Larger values explore more.

Implementations§

Source§

impl NaturalGradientPolicy

Source

pub fn suggest( &self, measurements: &[TuningMeasurement], fisher_inv_sqrt_q16: &[u32], ) -> Result<NaturalGradientTuningStep, NaturalGradientTuningError>

Suggest the next workgroup-size candidate from latency samples and an inverse-Fisher square-root matrix.

fisher_inv_sqrt_q16 is row-major n x n, 16.16 fixed-point. Passing an identity matrix makes the policy reduce to the softmax-gradient candidate. Non-identity blocks let the runtime bias exploration by the local latency manifold instead of blindly reusing the single fastest point.

§Errors

Returns NaturalGradientTuningError when the measurement set is empty, temperature is zero, or the Fisher matrix shape does not match.

Trait Implementations§

Source§

impl Clone for NaturalGradientPolicy

Source§

fn clone(&self) -> NaturalGradientPolicy

Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Copy for NaturalGradientPolicy

Source§

impl Debug for NaturalGradientPolicy

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl Default for NaturalGradientPolicy

Source§

fn default() -> Self

Returns the “default value” for a type. Read more
Source§

impl Eq for NaturalGradientPolicy

Source§

impl PartialEq for NaturalGradientPolicy

Source§

fn eq(&self, other: &NaturalGradientPolicy) -> bool

Tests for self and other values to be equal, and is used by ==.
1.0.0 (const: unstable) · Source§

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.
Source§

impl StructuralPartialEq for NaturalGradientPolicy

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<Q, K> Equivalent<K> for Q
where Q: Eq + ?Sized, K: Borrow<Q> + ?Sized,

Source§

fn equivalent(&self, key: &K) -> bool

Checks if this value is equivalent to the given key. Read more
Source§

impl<Q, K> Equivalent<K> for Q
where Q: Eq + ?Sized, K: Borrow<Q> + ?Sized,

Source§

fn equivalent(&self, key: &K) -> bool

Compare self to key and return true if they are equal.
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more