Enum FineTuneMethod 

pub enum FineTuneMethod {
    LoRA {
        rank: u32,
        alpha: f32,
    },
    QLoRA {
        rank: u32,
        bits: u8,
    },
    Adapter,
    Prefix,
    IA3,
    Full,
}

Fine-tuning methods

Variants

LoRA

Low-Rank Adaptation

Fields

rank: u32

Rank of the low-rank matrices

alpha: f32

Scaling factor (alpha)

QLoRA

Quantized LoRA (4-bit base weights)

Fields

rank: u32

Rank of the low-rank matrices

bits: u8

Quantization bits (typically 4)

Adapter

Adapter layers

Prefix

Prefix tuning

IA3

IA3 (Infused Adapter by Inhibiting and Amplifying Inner Activations)

Full

Full fine-tuning (all parameters)

Implementations

impl FineTuneMethod

pub fn lora(rank: u32) -> Self

Create LoRA with default alpha = rank

pub fn qlora(rank: u32) -> Self

Create QLoRA with 4-bit quantization

pub fn memory_reduction_factor(&self) -> f64

Get the memory reduction factor compared to full fine-tuning

pub fn trainable_params_percent(&self) -> f64

Get typical trainable parameter percentage

pub fn memory_multiplier(&self) -> f64

Memory multiplier relative to inference-only model size during training.

pub fn training_speedup(&self) -> f64

Training speedup factor relative to training from scratch.

pub fn quality_retention(&self) -> f64

Expected quality retention as a fraction of full fine-tuning quality.

pub fn batch_size_multiplier(&self) -> f64

Recommended batch size multiplier due to lower memory usage.

Trait Implementations

impl Clone for FineTuneMethod

fn clone(&self) -> FineTuneMethod

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for FineTuneMethod

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl<'de> Deserialize<'de> for FineTuneMethod

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Display for FineTuneMethod

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for FineTuneMethod

fn eq(&self, other: &FineTuneMethod) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Serialize for FineTuneMethod

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.

impl StructuralPartialEq for FineTuneMethod