pub struct LoraConfig {
pub rank: usize,
pub alpha: f32,
pub dropout: f32,
pub target_modules: Vec<String>,
pub fan_in_fan_out: bool,
}Expand description
Configuration for LoRA adaptation
Fields§
§rank: usizeRank of the low-rank decomposition (typically 4-64)
alpha: f32Scaling factor (typically equal to rank or 2*rank)
dropout: f32Dropout probability for LoRA layers (0.0 = no dropout)
target_modules: Vec<String>Which module names to apply LoRA to (e.g., “q_proj”, “v_proj”)
fan_in_fan_out: boolWhether weight is stored as (fan_in, fan_out) instead of (fan_out, fan_in)
Implementations§
Source§impl LoraConfig
impl LoraConfig
Sourcepub fn new(rank: usize, alpha: f32) -> Self
pub fn new(rank: usize, alpha: f32) -> Self
Create a new LoRA configuration with the given rank and alpha
Sourcepub fn with_dropout(self, dropout: f32) -> Self
pub fn with_dropout(self, dropout: f32) -> Self
Set dropout probability
Sourcepub fn with_target_modules(self, modules: Vec<String>) -> Self
pub fn with_target_modules(self, modules: Vec<String>) -> Self
Set target module names
Sourcepub fn with_fan_in_fan_out(self, fan_in_fan_out: bool) -> Self
pub fn with_fan_in_fan_out(self, fan_in_fan_out: bool) -> Self
Set fan_in_fan_out flag
Sourcepub fn validate(&self) -> ModelResult<()>
pub fn validate(&self) -> ModelResult<()>
Validate the configuration
Trait Implementations§
Source§impl Clone for LoraConfig
impl Clone for LoraConfig
Source§fn clone(&self) -> LoraConfig
fn clone(&self) -> LoraConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for LoraConfig
impl Debug for LoraConfig
Source§impl<'de> Deserialize<'de> for LoraConfig
impl<'de> Deserialize<'de> for LoraConfig
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for LoraConfig
impl RefUnwindSafe for LoraConfig
impl Send for LoraConfig
impl Sync for LoraConfig
impl Unpin for LoraConfig
impl UnsafeUnpin for LoraConfig
impl UnwindSafe for LoraConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> Instrument for T
impl<T> Instrument for T
Source§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
Source§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more