pub enum WeightKind {
Base,
LoraAdapter {
adapter: String,
},
TiedAlias {
target: WeightHandle,
},
}Expand description
What role a weight plays. Drives downstream scheduling (LoRA-aware request grouping) and accounting.
Variants§
Base
A base model weight — independent storage.
LoraAdapter
A LoRA adapter’s slice (down-proj A or up-proj B).
Multiple adapters can attach to the same base; the
scheduler groups requests by adapter name.
TiedAlias
A view that resolves to another weight’s storage. Used for
tied embeddings — embed_tokens.weight and
lm_head.weight are the same buffer, two names.
Fields
§
target: WeightHandleTrait Implementations§
Source§impl Clone for WeightKind
impl Clone for WeightKind
Source§fn clone(&self) -> WeightKind
fn clone(&self) -> WeightKind
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreAuto Trait Implementations§
impl Freeze for WeightKind
impl RefUnwindSafe for WeightKind
impl Send for WeightKind
impl Sync for WeightKind
impl Unpin for WeightKind
impl UnsafeUnpin for WeightKind
impl UnwindSafe for WeightKind
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more