Struct UpdateWeightFromDiskReqInput 

pub struct UpdateWeightFromDiskReqInput {
    pub rid: Option<StrOrList>,
    pub http_worker_ipc: Option<String>,
    pub model_path: String,
    pub load_format: Option<String>,
    pub weight_version: Option<String>,
    pub flush_cache: bool,
}

Load new weights from a checkpoint on disk.

Fields

rid: Option<StrOrList>

Request id; control operations rarely set it.

http_worker_ipc: Option<String>

In-process HTTP worker address; unused across processes.

model_path: String

The checkpoint.

load_format: Option<String>

Its format.

weight_version: Option<String>

The weight version after a successful load.

flush_cache: bool

Drop the cached KV first: it was computed under the old weights.

Trait Implementations

impl Clone for UpdateWeightFromDiskReqInput

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for UpdateWeightFromDiskReqInput

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for UpdateWeightFromDiskReqInput

fn eq(&self, other: &Self) -> bool

Equality operator ==.

fn ne(&self, other: &Rhs) -> bool

Inequality operator !=.

impl StructuralPartialEq for UpdateWeightFromDiskReqInput

impl Wire for UpdateWeightFromDiskReqInput

fn encode(&self, encoder: &mut Encoder)

Append this value to a message.

fn decode(decoder: &mut Decoder<'_>) -> Result<Self>

Read one value of this type.