Struct LowLatencyOptimizer 

pub struct LowLatencyOptimizer<O, A>
where
    A: Float + Send + Sync + ScalarOperand + Debug,
    O: Optimizer<A, Ix1> + Send + Sync,
{ /* private fields */ }

Low-latency streaming optimizer

Implementations

impl<O, A> LowLatencyOptimizer<O, A>

where A: Float + Send + Sync + Default + Clone + Debug + ScalarOperand + 'static + Sum, O: Optimizer<A, Ix1> + Send + Sync + 'static,

pub fn new(_baseoptimizer: O, config: LowLatencyConfig) -> Result<Self>

Create a new low-latency optimizer

pub fn set_parameters(&mut self, parameters: Array1<A>)

Seed the parameter vector the optimizer will keep updating.

pub fn set_precomputation_min_confidence(&mut self, min_confidence: A)

Current parameter vector, if any step has been taken or seeded. Require a minimum predictor confidence before a pre-computed update is served, falling back to a full update below it.

No-op when pre-computation is disabled. Defaults to zero, which accepts any prediction that matches the arriving gradient.

pub fn parameters(&self) -> Option<&Array1<A>>

pub fn low_latency_step(&mut self, gradient: &Array1<A>) -> Result<Array1<A>>

Perform a low-latency update

pub fn try_pop_staged_update(&mut self) -> Option<Array1<A>>

Take the oldest staged update, if any.

pub fn staged_update_count(&self) -> usize

Number of updates currently staged.

pub fn get_performance_metrics(&self) -> LowLatencyMetrics

Get current performance metrics

pub fn is_meeting_latency_requirements(&self) -> bool

Check if optimizer is meeting latency requirements