Struct AsyncConnection 

pub struct AsyncConnection { /* private fields */ }

ZMQ DEALER connection to an Inferential server (async, tokio-based).

Implementations

impl AsyncConnection

pub async fn new(server: &str, client_id: &str, client_type: &str) -> Self

Create a new async connection.

pub fn model( &mut self, model_id: &str, latency_budget_ms: f32, priority: i32, ) -> AsyncModel<'_>

Create an AsyncModel handle bound to this connection.

pub async fn close(self)

Close the connection, consuming it.