pub type InferenceWaiters = Arc<Mutex<HashMap<String, Vec<Sender<InferenceResponse>>>>>;Expand description
Type alias for inference response waiters, keyed by session/request ID.
When distributed_infer() fires a request over GossipSub it registers a
oneshot sender here; the event loop wakes it when a matching
InferenceResponse arrives on the INFERENCE_RESULT topic.
Aliased Typeยง
pub struct InferenceWaiters { /* private fields */ }