Adapter Merging And Unmerging With Weight Fusion

via “adapter merging and unmerging”

Parameter-efficient fine-tuning — LoRA, QLoRA, adapter methods for LLMs on consumer GPUs.

Unique: Implements reversible weight merging by storing the original base weights separately and computing merged_weight = base_weight + adapter_weight, enabling unmerge_adapter() to restore the original state. The merge operation is mathematically simple but requires careful state management to support unmerging.

vs others: Eliminates adapter inference overhead (5-10% latency reduction) and removes PEFT runtime dependency, enabling deployment as standard transformers models, but at the cost of losing adapter modularity and storage efficiency.

via “model-merging-and-adapter-composition”

Train transformer language models with reinforcement learning.

Unique: Provides utilities for merging and composing LoRA adapters with support for weighted combinations and sequential stacking, enabling multi-task inference without separate model instances

vs others: More flexible than single-adapter inference because it supports adapter composition, while more efficient than maintaining separate models by combining adapters into single merged weights

Parameter-Efficient Fine-Tuning (PEFT)

Unique: Implements reversible adapter merging through method-specific merge logic that fuses adapter weights into base weights mathematically (e.g., LoRA: W' = W + alpha/r * A @ B^T), enabling both merged and unmerged states from the same checkpoint. The unmerge operation recovers original weights by subtracting the adapter contribution.

vs others: More flexible than permanent merging because unmerge() enables recovery of original weights and adapter separation, while merged models achieve inference latency parity with non-adapter baselines. Supports both merged and adapter-based deployment strategies from the same training run.