Struct DecodeTokenData 

pub struct DecodeTokenData {
    pub token_ids: Arc<RwLock<Storage>>,
    pub rope_cos: Arc<RwLock<Storage>>,
    pub rope_sin: Arc<RwLock<Storage>>,
    pub mask: Arc<RwLock<Storage>>,
    pub offset: Option<Arc<RwLock<Storage>>>,
}

Per-token re-bound data-Const Arcs for a persistent decode step (Phase D · D2b). Each is a device-resident fuel_memory::Storage built from freshly recomputed host bytes (token-ids = the new token, RoPE cos+sin at position = cached_len, mask with the shifted -inf boundary). DecodeSession::realize_token overwrites the held base_cache’s stable data-Const entries with these for the token.

Fields

token_ids: Arc<RwLock<Storage>>

rope_cos: Arc<RwLock<Storage>>

rope_sin: Arc<RwLock<Storage>>

mask: Arc<RwLock<Storage>>

offset: Option<Arc<RwLock<Storage>>>

The device-resident KV-write offset (cached_len as a rank-0 I64), present ONLY on the device-offset decode path (CUDA/CPU targets, where Op::WriteSliceDoff reads the start from this buffer at kernel launch — capture-ready). None on the SymEnv path (Vulkan), where the KV write is Op::WriteSlice with a DynScalar::Sym(cached_len) offset resolved host-side per token.