Struct PrefillConfig 

pub struct PrefillConfig {
    pub peer: PeerConfig,
    pub layout: PrefillLayout,
    pub status_rank: i64,
    pub bootstrap_url: String,
    pub bootstrap_payload: Value,
    pub bootstrap_timeout: Duration,
    pub failed_session_ttl: Duration,
    pub transfer_workers: usize,
    pub layerwise: Option<Layerwise>,
}

A Prefill rank’s settings.

Fields

peer: PeerConfig

What both roles share.

layout: PrefillLayout

What this rank plans its routes and copies with.

status_rank: i64

This rank in Decode’s completion-tracking rank space.

bootstrap_url: String

The bootstrap server’s registration route.

bootstrap_payload: Value

What this rank registers there, but its control port.

bootstrap_timeout: Duration

A request whose Decode ranks have not all pre-allocated this long after registration fails.

failed_session_ttl: Duration

After a transfer to a session fails, its later transfers fail fast for this long; zero disables.

transfer_workers: usize

Transfer workers.

layerwise: Option<Layerwise>

Layerwise streaming, when on.

Trait Implementations

impl Clone for PrefillConfig

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for PrefillConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.