Skip to main content

Module rpc

Module rpc 

Source
Expand description

RPC backend support for distributed inference

This module provides support for running inference across multiple machines using the RPC (Remote Procedure Call) backend.

Re-exports§

pub use backend::RpcBackend;
pub use server::RpcServer;
pub use error::RpcError;
pub use server::add_rpc_device;

Modules§

backend
RPC backend for distributed inference
error
Error types for RPC functionality
server
RPC server for hosting backends