Expand description
RPC backend support for distributed inference
This module provides support for running inference across multiple machines using the RPC (Remote Procedure Call) backend.
A single endpoint can expose several devices, so both connecting
(RpcBackend::init) and serving (serve) are device-aware: clients
address a remote device by index, in the order the server listed them.
Re-exports§
pub use backend::RpcBackend;pub use error::RpcError;pub use server::add_rpc_server;pub use server::serve;