pub struct UpdateWeightsFromDistributedReqInput {
pub rid: Option<StrOrList>,
pub http_worker_ipc: Option<String>,
pub names: Vec<String>,
pub dtype_names: Vec<String>,
pub shapes: Vec<Vec<i64>>,
pub group_name: String,
pub flush_cache: bool,
pub weight_version: Option<String>,
}Expand description
Receive new weights from the trainer’s NCCL group.
Fields§
§rid: Option<StrOrList>Request id; control operations rarely set it.
http_worker_ipc: Option<String>In-process HTTP worker address; unused across processes.
names: Vec<String>Parameter names, in broadcast order.
dtype_names: Vec<String>Their dtypes.
shapes: Vec<Vec<i64>>Their shapes.
group_name: StringThe weight-update group.
flush_cache: boolDrop the cached KV first.
weight_version: Option<String>The L3 namespace afterwards; None keeps the current one.
Trait Implementations§
impl StructuralPartialEq for UpdateWeightsFromDistributedReqInput
Auto Trait Implementations§
impl Freeze for UpdateWeightsFromDistributedReqInput
impl RefUnwindSafe for UpdateWeightsFromDistributedReqInput
impl Send for UpdateWeightsFromDistributedReqInput
impl Sync for UpdateWeightsFromDistributedReqInput
impl Unpin for UpdateWeightsFromDistributedReqInput
impl UnsafeUnpin for UpdateWeightsFromDistributedReqInput
impl UnwindSafe for UpdateWeightsFromDistributedReqInput
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more