Struct Layerwise 

pub struct Layerwise {
    pub step_address: usize,
    pub fields_by_step: Vec<Vec<String>>,
    pub interval: usize,
}

Layerwise streaming: each prefill chunk’s KV goes out an interval of producer steps at a time, as the forward writes it.

Fields

step_address: usize

The pinned host word the device updates with the last producer step whose KV landed (StepCounter).

fields_by_step: Vec<Vec<String>>

The fields each producer step makes ready, in step order (CacheProducerSchedule).

interval: usize

Producer steps per transfer interval.

Trait Implementations

impl Clone for Layerwise

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Layerwise

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.