Struct LoraAdapter 

pub struct LoraAdapter {
    pub a: Param<Tensor<2>>,
    pub b: Param<Tensor<2>>,
    pub scale: f64,
}

A LoRA (Low-Rank Adaptation) adapter attached to a frozen weight parameter.

When present on a Param<Tensor<2>>, the parameter materializes its effective value as base + scale * (a @ b), where base is the frozen (and optionally quantized) weight and a/b are the trainable low-rank factors. The frozen base is the stored value of the parameter; the adapter factors are surfaced to the optimizer, autodiff and record systems as regular parameters with their own ParamIds through the module visitor/mapper traversal.

Fields

a: Param<Tensor<2>>

Down-projection factor with shape [d_in, rank] (trainable).

b: Param<Tensor<2>>

Up-projection factor with shape [rank, d_out] (trainable).

scale: f64

Scaling factor applied to the low-rank product, typically alpha / rank.

Implementations

impl LoraAdapter

pub fn delta(&self) -> Tensor<2>

Compute the low-rank delta scale * (a @ b) with shape [d_in, d_out].

a and b are read through Param::val, so the delta always reflects the current (optimizer-updated) factors and keeps them as autodiff leaves for backpropagation.

Trait Implementations

impl Clone for LoraAdapter

fn clone(&self) -> LoraAdapter

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LoraAdapter

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.