Expand description
LoRA/QLoRA configuration optimizer and memory planner.
This crate provides tools for:
- Optimal LoRA configuration based on memory constraints
- Memory planning for different fine-tuning methods
- Adapter merging and inspection
§Toyota Way Principles
- Heijunka: Memory planner levels resource allocation
- Kaizen: Iterative configuration refinement
- Muda Elimination: Optimal rank selection avoids wasted parameters
Re-exports§
pub use memory::MemoryPlanner;pub use memory::MemoryRequirement;pub use merge::MergeEngine;pub use optimizer::LoraOptimizer;pub use optimizer::OptimalConfig;
Modules§
- memory
- Memory planning for LoRA configurations (Heijunka principle).
- merge
- LoRA adapter merging (SMED principle - quick changeover).
- optimizer
- LoRA configuration optimizer (Kaizen principle).
Enums§
- Method
- Fine-tuning method.
Functions§
- plan
- Plan an optimal LoRA configuration for given constraints.