Struct ClientConfig 

pub struct ClientConfig {
    pub handshake_address: String,
    pub input_address: String,
    pub output_address: String,
    pub first_engine_index: u16,
    pub num_engines: u16,
    pub routing: Routing,
    pub handshake_timeout: Duration,
    pub send_timeout: Duration,
}

Where the client listens and which engines it expects.

Fields

handshake_address: String

Handshake ROUTER address the engines dial: the engine’s tcp://{--data-parallel-address}:{--data-parallel-rpc-port}. tcp://<host>:0 binds a free port; see crate::ClientListener.

input_address: String

Input ROUTER address. tcp://<host>:0 binds a free port; the bound address is sent to the engines, so <host> must be reachable from them.

output_address: String

Output PULL address, bound like input_address.

first_engine_index: u16

The first engine’s index, the engine’s --zmq-engine-index.

num_engines: u16

Engines to wait for: indices first_engine_index..+num_engines, one per attention-DP rank.

routing: Routing

Request placement.

handshake_timeout: Duration

Limit for the handshake, from the start of crate::ClientListener::accept to the last registration.

send_timeout: Duration

Limit for handing one message to an engine’s socket. A stalled engine fails the submission instead of blocking the caller.

Trait Implementations

impl Clone for ClientConfig

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for ClientConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.