pub struct LoraConfig {
pub rank: usize,
pub alpha: f64,
pub dropout: f64,
pub target_modules: Vec<String>,
pub seed: u64,
}Expand description
Configuration for a LoRA adapter layer.
LoRA (Low-Rank Adaptation, Hu et al., 2021) decomposes weight updates as
dW = B @ A where B in R^{d x r}, A in R^{r x k}, and r << min(d, k).
The effective scaling factor applied is alpha / rank.
Fields§
§rank: usizeLow-rank dimension r.
alpha: f64Scaling factor: effective scaling = alpha / rank.
dropout: f64Dropout probability for training regularisation (0.0 = no dropout).
target_modules: Vec<String>Which weight matrices to adapt (matched by name).
seed: u64RNG seed for reproducible A-matrix initialisation.
Trait Implementations§
Source§impl Clone for LoraConfig
impl Clone for LoraConfig
Source§fn clone(&self) -> LoraConfig
fn clone(&self) -> LoraConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for LoraConfig
impl Debug for LoraConfig
Auto Trait Implementations§
impl Freeze for LoraConfig
impl RefUnwindSafe for LoraConfig
impl Send for LoraConfig
impl Sync for LoraConfig
impl Unpin for LoraConfig
impl UnsafeUnpin for LoraConfig
impl UnwindSafe for LoraConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more