Struct QValue 

pub struct QValue {
    pub mean: f64,
    pub variance: f64,
    pub update_count: u64,
    pub last_updated: Timestamp,
}

Represents the learned value (Q-value) of a state-action pair, with associated statistics.

Fields

mean: f64

The mean learned value for this state-action pair.

variance: f64

The variance of the Q-value, indicating uncertainty.

update_count: u64

The number of times this Q-value has been updated.

last_updated: Timestamp

The timestamp of the last update.

Implementations

impl QValue

pub fn new(initial_value: f64) -> Self

Creates a new QValue with an initial value.

pub fn update(&mut self, new_value: f64, learning_rate: f64)

Updates the Q-value using a new sample and a learning rate. This uses Welford’s algorithm for incremental variance calculation.

pub fn confidence(&self) -> Confidence

Returns the confidence in this Q-value, based on update count and variance.

Trait Implementations

impl Clone for QValue

fn clone(&self) -> QValue

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for QValue

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for QValue

fn default() -> Self

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for QValue

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for QValue

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.