pub enum TargetModule {
QProj,
KProj,
VProj,
OProj,
GateProj,
UpProj,
DownProj,
}Expand description
Target modules for LoRA adaptation.
Specifies which layers in the model should have LoRA applied.
Variants§
QProj
Query projection in attention
KProj
Key projection in attention
VProj
Value projection in attention
OProj
Output projection in attention
GateProj
Gate projection in MLP
UpProj
Up projection in MLP
DownProj
Down projection in MLP
Implementations§
Trait Implementations§
Source§impl Clone for TargetModule
impl Clone for TargetModule
Source§fn clone(&self) -> TargetModule
fn clone(&self) -> TargetModule
Returns a duplicate of the value. Read more
1.0.0§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for TargetModule
impl Debug for TargetModule
Source§impl Hash for TargetModule
impl Hash for TargetModule
Source§impl PartialEq for TargetModule
impl PartialEq for TargetModule
impl Eq for TargetModule
impl StructuralPartialEq for TargetModule
Auto Trait Implementations§
impl Freeze for TargetModule
impl RefUnwindSafe for TargetModule
impl Send for TargetModule
impl Sync for TargetModule
impl Unpin for TargetModule
impl UnwindSafe for TargetModule
Blanket Implementations§
§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§unsafe fn clone_to_uninit(&self, dest: *mut u8)
unsafe fn clone_to_uninit(&self, dest: *mut u8)
🔬This is a nightly-only experimental API. (
clone_to_uninit)Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
Source§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more