pub struct WeightRef {
pub name: String,
pub uri: String,
pub packed: bool,
}Expand description
Where one parameter’s data comes from. The worker resolves the uri
itself, so large weights stay node-local.
Fields§
§name: String§uri: StringOpaque to rlx core — the caller’s resolver interprets it (e.g.
gguf:///models/x.gguf#blk.0.ffn, file:///…, hf://…).
packed: boolIf set, load the quantized bytes as-is (U8 param) instead of
dequantizing to f32 — the graph’s DequantMatMul decodes them at
matmul time, so the weight stays at native quant memory (e.g. Q4_K)
with no dequant round-trip. The coordinator sets this when it built a
DequantMatMul graph for the stage.
Trait Implementations§
Source§impl<'de> Deserialize<'de> for WeightRef
impl<'de> Deserialize<'de> for WeightRef
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for WeightRef
impl RefUnwindSafe for WeightRef
impl Send for WeightRef
impl Sync for WeightRef
impl Unpin for WeightRef
impl UnsafeUnpin for WeightRef
impl UnwindSafe for WeightRef
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> DeserializeOwned for Twhere
T: for<'de> Deserialize<'de>,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more