Struct DecodeConfig 

pub struct DecodeConfig {
    pub peer: PeerConfig,
    pub arena_base: u64,
    pub layout: Vec<u8>,
    pub tp_size: i64,
    pub tp_rank: i64,
    pub waiting_timeout: Duration,
    pub heartbeat_interval: Duration,
    pub heartbeat_max_failures: u32,
}

A Decode rank’s settings.

Fields

peer: PeerConfig

What both roles share.

arena_base: u64

What this rank registers with a Prefill rank: its cache arena base, its cache transfer contract’s wire bytes (with its landing addresses), and its attention TP size and rank.

layout: Vec<u8>

See arena_base.

tp_size: i64

See arena_base.

tp_rank: i64

See arena_base.

waiting_timeout: Duration

A request whose manifest went out this long ago without its KV landing fails.

heartbeat_interval: Duration

How often the Prefill nodes’ health is checked.

heartbeat_max_failures: u32

Failed checks in a row after which a Prefill node counts as lost.

Trait Implementations

impl Clone for DecodeConfig

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for DecodeConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.