Trait Mergeable
Source pub trait Mergeable: Adapter {
// Required methods
fn merge(&self, base_weight: &Tensor) -> Result<Tensor, PeftError>;
fn unmerge(&self, merged_weight: &Tensor) -> Result<Tensor, PeftError>;
}
Expand description
Trait for adapters that can be merged into base weights.
Merge adapter weights into base model weights.
§Arguments
base_weight - The original weight tensor to merge into
§Returns
New tensor with adapter weights merged
§Errors
Returns an error if merging fails.
Unmerge adapter weights from merged weights.
§Arguments
merged_weight - Weight tensor with adapter already merged
§Returns
Original base weight tensor
§Errors
Returns an error if unmerging fails.