Update README.md
Browse files
README.md
CHANGED
@@ -12,7 +12,7 @@ pipeline_tag: text-generation
|
|
12 |
|
13 |
# π€ LLM Evolutionary Merge
|
14 |
|
15 |
-
π€ [Model](https://huggingface.co/fiveflow/LLMEvoLLaMA-3.1-8B-v0.1) | π [Github](https://github.com/kwon13/LLM-Evo-Merge) | βοΈ [Blog](
|
16 |
|
17 |
![robot](./assets/robot.jpeg)
|
18 |
This project aims to optimize model merging by integrating LLMs into evolutionary strategies in a novel way. Instead of using the [CMA-ES](https://en.wikipedia.org/wiki/CMA-ES) approach, the goal is to improve model optimization by [leveraging the search capabilities of LLMs](https://arxiv.org/abs/2402.18381) to explore the parameter space more efficiently and adjust the search scope based on high-performing solutions.
|
|
|
12 |
|
13 |
# π€ LLM Evolutionary Merge
|
14 |
|
15 |
+
π€ [Model](https://huggingface.co/fiveflow/LLMEvoLLaMA-3.1-8B-v0.1) | π [Github](https://github.com/kwon13/LLM-Evo-Merge) | βοΈ [Blog](https://fiveflow.notion.site/LLM-based-Evolution-Strategy-Merging-1254cec6dd278041a7f6c07dc4039fe8?pvs=4) | π‘[Inspired by Sakana AI](https://github.com/SakanaAI/evolutionary-model-merge)
|
16 |
|
17 |
![robot](./assets/robot.jpeg)
|
18 |
This project aims to optimize model merging by integrating LLMs into evolutionary strategies in a novel way. Instead of using the [CMA-ES](https://en.wikipedia.org/wiki/CMA-ES) approach, the goal is to improve model optimization by [leveraging the search capabilities of LLMs](https://arxiv.org/abs/2402.18381) to explore the parameter space more efficiently and adjust the search scope based on high-performing solutions.
|