Skip to main content

set_decode_phase

Function set_decode_phase 

Source
pub fn set_decode_phase(p: Option<usize>)
Expand description

TOKEN-PIPELINE phase (step37 chain): while Some(p), enter_main binds each gpu’s phase-p stream instead of its main stream, so alternate tokens’ rank-local work rides disjoint streams. Cross-stream ordering is the SETTER’s job (the multi-stream law above): the chain wires per-layer KV events between phases.