Struct UpdateWeightsFromTensorReqInput 

pub struct UpdateWeightsFromTensorReqInput {
    pub rid: Option<StrOrList>,
    pub http_worker_ipc: Option<String>,
    pub serialized_named_tensors: Vec<Value>,
    pub load_format: Option<String>,
    pub flush_cache: bool,
    pub weight_version: Option<String>,
}

Load weights from serialized tensors; the engines refuse it.

Fields

rid: Option<StrOrList>

Request id; control operations rarely set it.

http_worker_ipc: Option<String>

In-process HTTP worker address; unused across processes.

serialized_named_tensors: Vec<Value>

One serialized tensor dict per world rank.

load_format: Option<String>

Their format.

flush_cache: bool

Drop the cached KV first.

weight_version: Option<String>

The weight version afterwards.

Trait Implementations

impl Clone for UpdateWeightsFromTensorReqInput

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for UpdateWeightsFromTensorReqInput

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for UpdateWeightsFromTensorReqInput

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for UpdateWeightsFromTensorReqInput

impl Wire for UpdateWeightsFromTensorReqInput

fn encode(&self, encoder: &mut Encoder)

Append this value to a message.

fn decode(decoder: &mut Decoder<'_>) -> Result<Self>

Read one value of this type.