Struct LoraConfig 

pub struct LoraConfig {
    pub rank: usize,
    pub alpha: f64,
    pub init_std: Option<f64>,
    pub param_group: ParamGroup,
}

Configuration describing how to attach LoRA adapters to a module’s weights.

Fields

rank: usize

Rank of the low-rank decomposition.

alpha: f64

Scaling numerator; the adapter contribution is scaled by alpha / rank.

init_std: Option<f64>

Standard deviation used to initialize the A factor. Defaults to 1 / rank.

param_group: ParamGroup

The parameter group on which to apply the LoRA.

Implementations

impl LoraConfig

pub fn new(rank: usize, alpha: f64) -> Self

Create a new LoRA configuration with the given rank and alpha.

pub fn set_param_group(self, group: ParamGroup) -> Self

Set the parameter group to quantize on which to apply the LoRA.

Trait Implementations

impl Clone for LoraConfig

fn clone(&self) -> LoraConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LoraConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.