Skip to main content

add_rpc_server

Function add_rpc_server 

Source
pub fn add_rpc_server(
    endpoint: &str,
) -> Result<NonNull<ggml_backend_reg>, RpcError>
Expand description

Register a remote RPC server with the ggml backend registry.

Returns the backend registration covering every device the endpoint exposes; use RpcBackend::init to bind one of those devices.

ยงErrors

Returns RpcError::StringConversion if endpoint contains an interior NUL, or RpcError::InitializationFailed if the endpoint could not be registered.