Struct Client 

pub struct Client { /* private fields */ }

A client object used by the master to connect and orchestrate the workers. From the Cake perspective, each worker is a server and the master uses multiple Client instances to connect to them.

Implementations

impl Client

pub async fn new( device: Device, address: &str, layer_name: &str, cluster_key: Option<&str>, ) -> Result<Self>

Connects to the given worker address. NOTE: device and layer_name here are only passed for std::fmt::Display. If cluster_key is provided, mutual PSK authentication is performed before any protocol messages.

Trait Implementations

impl Debug for Client

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Display for Client

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Forwarder for Client

fn forward_mut<'life0, 'life1, 'life2, 'async_trait>( &'life0 mut self, x: &'life1 Tensor, index_pos: usize, block_idx: usize, _: &'life2 mut Context, ) -> Pin<Box<dyn Future<Output = Result<Tensor>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Executes the worker’s pipeline for this tensor.

fn forward_batch<'life0, 'life1, 'life2, 'async_trait>( &'life0 mut self, x: &'life1 Tensor, batch: Vec<(String, usize, usize)>, _: &'life2 mut Context, ) -> Pin<Box<dyn Future<Output = Result<Tensor>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Executes the worker’s pipeline with multiple batched steps for this tensor.

fn load(_: String, _: &Context) -> Result<Box<Self>>

Create an instance of this object loading the specified layer(s) from a VarBuilder.

fn forward<'life0, 'life1, 'life2, 'async_trait>( &'life0 self, _: &'life1 Tensor, __arg2: usize, __arg3: usize, _: &'life2 mut Context, ) -> Pin<Box<dyn Future<Output = Result<Tensor>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Applies a forward operation to the input tensor, does not require mutability.

fn goodbye<'life0, 'async_trait>( &'life0 mut self, ) -> Pin<Box<dyn Future<Output = Result<()>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

fn layer_name(&self) -> &str

Return the layer name.

fn ident(&self) -> &str

Return the unique identity or local.