Struct LoraConfig 

pub struct LoraConfig {
    pub r: usize,
    pub alpha: usize,
    pub dropout: f64,
    pub target_modules: Vec<String>,
    pub init_lora_weights: LoraInitialization,
    pub use_dora: bool,
    pub use_rslora: bool,
    pub loftq_iterations: usize,
}

Configuration for LoRA adapters.

Fields

r: usize

Rank of the low-rank decomposition.

alpha: usize

Scaling factor (typically alpha / r).

dropout: f64

Dropout probability applied to LoRA outputs.

target_modules: Vec<String>

Target modules to apply LoRA to.

init_lora_weights: LoraInitialization

Initialize A with Gaussian, B with zeros (standard) or vice versa.

use_dora: bool

Enable DoRA (Weight-Decomposed Low-Rank Adaptation). When enabled, the weight update is decomposed into magnitude and direction.

use_rslora: bool

Enable rank-stabilized LoRA (rsLoRA).

When enabled, uses alpha / sqrt(r) scaling instead of alpha / r. This provides better stability and performance at higher ranks.

Reference: https://arxiv.org/abs/2312.03732

loftq_iterations: usize

LoftQ initialization for quantization-aware LoRA.

Uses SVD-based initialization optimized for quantized base models. Specify the number of iterations (0 = disabled).

Trait Implementations

impl AdapterConfig for LoraConfig

fn validate(&self) -> Result<(), PeftError>

Validate the configuration parameters.

impl Clone for LoraConfig

fn clone(&self) -> LoraConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LoraConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Default for LoraConfig

fn default() -> LoraConfig

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for LoraConfig

fn deserialize<__D>( __deserializer: __D, ) -> Result<LoraConfig, <__D as Deserializer<'de>>::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for LoraConfig

fn serialize<__S>( &self, __serializer: __S, ) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.