Evolutionary Optimization of Model Merging Recipes

Ranked by how close their title and abstract are to this paper’s. Select some to read them together.

Closest papers

1. Very close Builds on this paper Cites this paper Uses this paper in depth Not relevant

   EvoGM: Learning to Merge LLMs via Evolutionary Generative Optimization

   Tao Jiang, Xin-Meng Yu, Chen-Hao Yi et al. · 2026 · arXiv.org · preprint, not peer reviewed · cited 3 times · Not summarized yet

   EvoGM replaces the hand-crafted evolutionary operators used in earlier model-merging work with learnable generative optimization of merging coefficients.

   Abstract

   Evolutionary model merging provides a powerful framework for the automated, training-free composition of LLMs through parameter-space search. However, existing methods predominantly rely on stochastic, hand-crafted operators that overlook the underlying performance landscape of the coefficient space. We propose Evolutionary Generative Merging (EvoGM), a framework that transcends manual heuristics by employing learnable generative modeling to optimize merging coefficients. Specifically, EvoGM features a dual-generator architecture with cycle-consistent learning to adaptively sample and refine promising merging candidates. By constructing winner-loser pairs from historical search trajectories,…

2. Very close Another approach to the problem Cites this paper Uses this paper in depth Not relevant

   Fine, I'll Merge It Myself: A Multi-Fidelity Framework for Automated Model Merging

   Gui-Nan Su, Jonas Geiping · 2025 · arXiv.org · preprint, not peer reviewed · cited 5 times · Not summarized yet

   Fine, I'll Merge It Myself automates model-merging strategy search using multi-fidelity approximations, rather than evolutionary optimization.

   Abstract

   Reasoning capabilities represent a critical frontier for large language models (LLMs), but developing them requires extensive proprietary datasets and computational resources. One way to efficiently supplement capabilities with is by model merging, which offers a promising alternative by combining multiple models without retraining. However, current merging approaches rely on manually-designed strategies for merging hyperparameters, limiting the exploration of potential model combinations and requiring significant human effort. We propose an Automated Model Merging Framework that enables fine-grained exploration of merging strategies while reducing costs through multi-fidelity approximations…

3. Very close Same method, another problem Not relevant

   Multi-objective Evolutionary Merging Enables Efficient Reasoning Models

   M. Iacobelli, Adrian Robert Minut, Tommaso Mencattini et al. · 2026 · arXiv.org · preprint, not peer reviewed · Not summarized yet

   Evo-L2S uses multi-objective evolutionary merging to trade off reasoning accuracy and output length.

   Abstract

   Reasoning models achieve strong performance on complex problems by leveraging long chains of thought, but this deliberate reasoning incurs substantial inference-time cost. The Long-to-Short (L2S) reasoning problem seeks to preserve accuracy while reducing generated tokens. Yet, current training-free model merging approaches rely on brittle, fixed-hyperparameter arithmetic methods that force suboptimal compromises. We introduce \textbf{Evo-L2S}, a multi-objective evolutionary model merging framework that explicitly optimizes accuracy and output length to recover a Pareto front of merged models. To make this search computationally tractable, we propose an entropy-based subset sampling techniqu…

4. Very close Same method, another problem Cites this paper Not relevant

   Evolutionary Soups: Evolving Mixture-of-Experts for Multi-Objective LLM Alignment

   Lingxiao Kong, Steffen Staab, Cong Yang et al. · 2026 · arXiv.org · preprint, not peer reviewed · Not summarized yet

   Evolutionary Soups applies evolutionary optimization to merge expert models for controllable multi-objective generation.

   Abstract

   Large language models are increasingly required to generate responses that satisfy multiple competing objectives. Since optimal trade-offs depend on both user preferences and input prompts, controllable multi-objective generation must dynamically adapt models at inference time without retraining. To address this, we propose Evolutionary Soups, a mixture-of-experts framework for fine-grained generation control, with gating networks trained via an evolutionary algorithm. The per-layer gating networks dynamically produce expert-merging coefficients from hidden-state representations, while the evolutionary algorithm incorporates greedy hypervolume contribution for effective evolution of these ga…

5. Very close Shared data, tool or method Cites this paper Uses this paper in depth Not relevant

   Mergenetic: a Simple Evolutionary Model Merging Library

   Adrian Robert Minut, Tommaso Mencattini, Andrea Santilli et al. · 2025 · Annual Meeting of the Association for Computational Linguistics · cited 6 times · Not summarized yet

   Mergenetic provides an open-source library for composing evolutionary algorithms and model-merging methods.

   Abstract

   Model merging allows combining the capabilities of existing models into a new one - post hoc, without additional training. This has made it increasingly popular thanks to its low cost and the availability of libraries that support merging on consumer GPUs. Recent work shows that pairing merging with evolutionary algorithms can boost performance, but no framework currently supports flexible experimentation with such strategies in language models. We introduce Mergenetic, an open-source library for evolutionary model merging. Mergenetic enables easy composition of merging methods and evolutionary algorithms while incorporating lightweight fitness estimators to reduce evaluation costs. We descr…

6. Very close Broader context Cites this paper Not relevant

   Exploring Model Kinship for Merging Large Language Models

   Ye Hu, Yunzhi Yao, Ning-Yu Zhang et al. · 2024 · Conference on Empirical Methods in Natural Language Processing · cited 2 times · Not summarized yet

   Exploring Model Kinship studies how similarity between language models relates to gains from merging them.

   Abstract

   Model merging has emerged as a key technique for enhancing the capabilities and efficiency of Large Language Models (LLMs). The open-source community has driven model evolution by iteratively merging existing models, yet a principled understanding of the gains and underlying factors in model merging remains limited. In this work, we study model evolution through iterative merging, drawing an analogy to biological evolution, and introduce the concept of model kinship, the degree of similarity or relatedness between LLMs. Through comprehensive empirical analysis, we show that model kinship is closely linked to the performance improvements achieved by merging, providing a useful criterion for s…

7. Close Same method, another problem Cites this paper Uses this paper in depth Not relevant

   Model Merging to Evolution: Parameter Space Exploration for Expert Models

   Chao Wang, Yu-Chen Guo, Zheng Tan et al. · 2026 · Parallel Problem Solving from Nature · Not summarized yet

   MERGEvolve combines expert-model merging with evolutionary parameter-space exploration to improve models without additional training.

   Abstract

   Model merging integrates the capabilities of multiple expert models to create strong models for multiple tasks without additional training, thereby reducing computational resource requirements. However, existing methods operate within the convex combination space of expert models, failing to explore high-performance regions outside this space. This paper proposes the MERGEvolve framework, which unifies model merging and evolution within an evolution strategy by treating the merged model as the initialization for evolutionary exploration of the parameter space. During the merging phase, expert models act as deterministic sources to build a strong initial point. The evolution phase then explor…

8. Close Another approach to the problem Not relevant

   Knowledge Fusion of Large Language Models

   Fanqi Wan, Xinting Huang, Deng Cai et al. · 2024 · Computation and Language · cited 150 times · AI summary available

   Knowledge Fusion combines language-model capabilities through their generative distributions, addressing model composition without directly blending weights.

   Abstract

   While training large language models (LLMs) from scratch can generate models with distinct functionalities and strengths, it comes at significant costs and may result in redundant capabilities. Alternatively, a cost-effective and compelling approach is to merge existing pre-trained LLMs into a more potent model. However, due to the varying architectures of these LLMs, directly blending their weights is impractical. In this paper, we introduce the notion of knowledge fusion for LLMs, aimed at combining the capabilities of existing LLMs and transferring them into a single LLM. By leveraging the generative distributions of source LLMs, we externalize their collective knowledge and unique streng…

Prior work it builds on

1. Close Groundwork for this paper Used in depth by this paper Not relevant

   Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunch

   Le Yu, Bowen Yu, Haiyang Yu et al. · 2023 · Computation and Language · cited 904 times · AI summary available

   Language Models are Super Mario introduces DARE for absorbing capabilities from related models by sparsifying fine-tuning parameter changes.

   Abstract

   In this paper, we uncover that Language Models (LMs), either encoder- or decoder-based, can obtain new capabilities by assimilating the parameters of homologous models without retraining or GPUs. Typically, new abilities of LMs can be imparted by Supervised Fine-Tuning (SFT), reflected in the disparity between fine-tuned and pre-trained parameters (i.e., delta parameters). We initially observe that by introducing a novel operation called DARE (Drop And REscale), most delta parameters can be directly set to zeros without affecting the capabilities of SFT LMs and larger models can tolerate a higher proportion of discarded parameters. Based on this observation, we further sparsify delta paramet…

2. Close Groundwork for this paper Not relevant

   Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time

   Mitchell Wortsman, Gabriel Ilharco, Samir Yitzhak Gadre et al. · 2022 · Machine Learning · cited 1,904 times · AI summary available

   Model soups shows that averaging weights from fine-tuned models can improve accuracy without adding inference cost.

   Abstract

   The conventional recipe for maximizing model accuracy is to (1) train multiple models with various hyperparameters and (2) pick the individual model which performs best on a held-out validation set, discarding the remainder. In this paper, we revisit the second step of this procedure in the context of fine-tuning large pre-trained models, where fine-tuned models often appear to lie in a single low error basin. We show that averaging the weights of multiple models fine-tuned with different hyperparameter configurations often improves accuracy and robustness. Unlike a conventional ensemble, we may average many models without incurring any additional inference or memory costs -- we call the res…

3. Close Groundwork for this paper Not relevant

   Model Merging by Uncertainty-Based Gradient Matching

   Nico Daheim, Thomas Möllenhoff, E. Ponti et al. · 2023 · International Conference on Learning Representations · cited 97 times · Not summarized yet

   Model Merging by Uncertainty-Based Gradient Matching proposes a parameter-merging method that reduces gradient mismatch between models.

   Abstract

   Models trained on different datasets can be merged by a weighted-averaging of their parameters, but why does it work and when can it fail? Here, we connect the inaccuracy of weighted-averaging to mismatches in the gradients and propose a new uncertainty-based scheme to improve the performance by reducing the mismatch. The connection also reveals implicit assumptions in other schemes such as averaging, task arithmetic, and Fisher-weighted averaging. Our new method gives consistent improvements for large language models and vision transformers, both in terms of performance and robustness to hyperparameters. Code available here.

4. Close Groundwork for this paper Not relevant

   Git Re-Basin: Merging Models modulo Permutation Symmetries

   Samuel K. Ainsworth, Jonathan Hayase, Siddhartha Srinivasa · 2022 · Machine Learning · cited 598 times · AI summary available

   Git Re-Basin aligns neural-network parameters under permutation symmetries to make model weights more compatible.

   Abstract

   The success of deep learning is thanks to our ability to solve certain massive non-convex optimization problems with relative ease. Despite non-convex optimization being NP-hard, simple algorithms -- often variants of stochastic gradient descent -- exhibit surprising effectiveness in fitting large neural networks in practice. We argue that neural network loss landscapes contain (nearly) a single basin, after accounting for all possible permutation symmetries of hidden units. We introduce three algorithms to permute the units of one model to bring them into alignment with units of a reference model. This transformation produces a functionally equivalent set of weights that lie in an approxima…

5. Related Groundwork for this paper Used in depth by this paper Not relevant

   TIES-Merging: Resolving Interference When Merging Models

   Prateek Yadav, Derek Tam, Leshem Choshen et al. · 2023 · Neural Information Processing Systems · cited 1,078 times · Not summarized yet

   TIES-Merging addresses interference among task-specific model parameters when combining models without additional training.

   Abstract

   Transfer learning - i.e., further fine-tuning a pre-trained model on a downstream task - can confer significant advantages, including improved downstream performance, faster convergence, and better sample efficiency. These advantages have led to a proliferation of task-specific fine-tuned models, which typically can only perform a single task and do not benefit from one another. Recently, model merging techniques have emerged as a solution to combine multiple task-specific models into a single multitask model without performing additional training. However, existing merging methods often ignore the interference between parameters of different models, resulting in large performance drops when…

Papers that cite it

1. Close Broader context Uses this paper in depth Not relevant

   Model Merging and Safety Alignment: One Bad Model Spoils the Bunch

   Hasan Abed Al Kader Hammoud, Umberto Michieli, Fabio Pizzati et al. · 2024 · Conference on Empirical Methods in Natural Language Processing · cited 50 times · Not summarized yet

   Model Merging and Safety Alignment evaluates how merging transfers expertise and misalignment, then proposes adding synthetic safety data.

   Abstract

   Merging Large Language Models (LLMs) is a cost-effective technique for combining multiple expert LLMs into a single versatile model, retaining the expertise of the original ones. However, current approaches often overlook the importance of safety alignment during merging, leading to highly misaligned models. This work investigates the effects of model merging on alignment. We evaluate several popular model merging techniques, demonstrating that existing methods do not only transfer domain expertise but also propagate misalignment. We propose a simple two-step approach to address this problem: (i) generating synthetic safety and domain-specific data, and (ii) incorporating these generated dat…

2. Close Builds on this paper Uses this paper in depth Not relevant

   MERGE3: Efficient Evolutionary Merging on Consumer-grade GPUs

   Tommaso Mencattini, Adrian Robert Minut, Donato Crisostomi et al. · 2025 · International Conference on Machine Learning · cited 12 times · Not summarized yet

   MERGE3 lowers the evaluation cost of evolutionary merging and reports multilingual and cross-lingual model composition.

   Abstract

   Evolutionary model merging enables the creation of high-performing multi-task models but remains computationally prohibitive for consumer hardware. We introduce MERGE$^3$, an efficient framework that makes evolutionary merging feasible on a single GPU by reducing fitness computation costs 50$\times$ while preserving performance. MERGE$^3$ achieves this by Extracting a reduced dataset for evaluation, Estimating model abilities using Item Response Theory (IRT), and Evolving optimal merges via IRT-based performance estimators. Our method enables state-of-the-art multilingual and cross-lingual merging, transferring knowledge across languages with significantly lower computational overhead. We pr…

3. Close Broader context Uses this paper in depth Not relevant

   Surrogate Benchmarks for Model Merging Optimization

   Rio Akizuki, Yuya Kudo, Nozomu Yoshinari et al. · 2025 · arXiv.org · preprint, not peer reviewed · cited 3 times · Not summarized yet

   Surrogate Benchmarks develops low-cost benchmarks for optimizing model-merging hyperparameters.

   Abstract

   Model merging techniques aim to integrate the abilities of multiple models into a single model. Most model merging techniques have hyperparameters, and their setting affects the performance of the merged model. Because several existing works show that tuning hyperparameters in model merging can enhance the merging outcome, developing hyperparameter optimization algorithms for model merging is a promising direction. However, its optimization process is computationally expensive, particularly in merging LLMs. In this work, we develop surrogate benchmarks for optimization of the merging hyperparameters to realize algorithm development and performance comparison at low cost. We define two search…

4. Close Same method, another problem Uses this paper in depth Not relevant

   Darwin Family: MRI-Trust-Weighted Evolutionary Merging for Training-Free Scaling of Language-Model Reasoning

   Taebong Kim, Youn-Sik Hong, Minsik Kim et al. · 2026 · arXiv.org · preprint, not peer reviewed · Not summarized yet

   Darwin Family uses training-free evolutionary weight recombination to improve language-model reasoning capabilities.

   Abstract

   We present Darwin Family, a framework for training-free evolutionary merging of large language models via gradient-free weight-space recombination. We ask whether frontier-level reasoning performance can be improved without additional training, by reorganizing latent capabilities already encoded in existing checkpoints. Darwin introduces three key ideas: (i) a 14-dimensional adaptive merge genome enabling fine-grained component- and block-level recombination; (ii) MRI-Trust Fusion, which adaptively balances diagnostic layer-importance signals with evolutionary search through a learnable trust parameter; and (iii) an Architecture Mapper that enables cross-architecture breeding between heterog…

5. Close Same method, another problem Uses this paper in depth Not relevant

   Model Swarms: Collaborative Search to Adapt LLM Experts via Swarm Intelligence

   Shang-Bin Feng, Zifeng Wang, Yike Wang et al. · 2024 · International Conference on Machine Learning · cited 34 times · Not summarized yet

   Model Swarms uses collaborative search in weight space to adapt language models from a pool of experts.

   Abstract

   We propose Model Swarms, a collaborative search algorithm to adapt LLMs via swarm intelligence, the collective behavior guiding individual systems. Specifically, Model Swarms starts with a pool of LLM experts and a utility function. Guided by the best-found checkpoints across models, diverse LLM experts collaboratively move in the weight space and optimize a utility function representing model adaptation objectives. Compared to existing model composition approaches, Model Swarms offers tuning-free model adaptation, works in low-data regimes with as few as 200 examples, and does not require assumptions about specific experts in the swarm or how they should be composed. Extensive experiments d…