Skip to main content

PredictScheduler

rlmesh_runtime

Trait PredictScheduler 

Source 
pub trait PredictScheduler: Send {
    // Required method
    fn plan(&mut self, waiting: &[usize], busy: usize) -> Vec<usize>;
}
Expand description

Decides which groups waiting for a prediction go out next (as one grouped predict for a model that fuses them, one predict each otherwise). Consulted whenever at least one group is waiting and the model can take more; busy is how many groups are still stepping or resetting. An empty plan waits for the next event (a step or reset completing) — the driver forces a full plan when nothing else is in flight, so a scheduler cannot stall the route.

Required Methods§

Source

fn plan(&mut self, waiting: &[usize], busy: usize) -> Vec<usize>

Dyn Compatibility§

This trait is dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Implementors§