Update README.md
Browse files
README.md
CHANGED
@@ -126,7 +126,7 @@ Llama3-8B-SuperNova-Spectrum-dare_ties is a `dare_ties` merge of the following m
|
|
126 |
* **Redundancy Removal**: Identifies and eliminates overlapping or unnecessary information between models, making the final model more efficient.
|
127 |
* **Conflict Resolution**: Reconciles differences between models by creating a unified sign vector that represents the most dominant direction of change across all models.
|
128 |
|
129 |
-
**
|
130 |
|
131 |
<figure>
|
132 |
|
@@ -276,6 +276,7 @@ Average: 43.91%
|
|
276 |
## Special thanks & Reference
|
277 |
- Maxime Labonne for their easy-to-use colab-notebook [Merging LLMs with MergeKit](https://github.com/mlabonne/llm-course/blob/main/Mergekit.ipynb), [Blog](https://towardsdatascience.com/merge-large-language-models-with-mergekit-2118fb392b54) and [LLM-AutoEva Notebookl](https://github.com/mlabonne/llm-autoeval)
|
278 |
- Authors of [Mergekit](https://github.com/arcee-ai/mergekit)
|
|
|
279 |
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
|
280 |
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_yuvraj17__Llama3-8B-SuperNova-Spectrum-dare_ties)
|
281 |
|
|
|
126 |
* **Redundancy Removal**: Identifies and eliminates overlapping or unnecessary information between models, making the final model more efficient.
|
127 |
* **Conflict Resolution**: Reconciles differences between models by creating a unified sign vector that represents the most dominant direction of change across all models.
|
128 |
|
129 |
+
**TIES** stands for **T**R**I**M, **E**LECT **S**IGN & MERGE (TIES-MERGING).
|
130 |
|
131 |
<figure>
|
132 |
|
|
|
276 |
## Special thanks & Reference
|
277 |
- Maxime Labonne for their easy-to-use colab-notebook [Merging LLMs with MergeKit](https://github.com/mlabonne/llm-course/blob/main/Mergekit.ipynb), [Blog](https://towardsdatascience.com/merge-large-language-models-with-mergekit-2118fb392b54) and [LLM-AutoEva Notebookl](https://github.com/mlabonne/llm-autoeval)
|
278 |
- Authors of [Mergekit](https://github.com/arcee-ai/mergekit)
|
279 |
+
|
280 |
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
|
281 |
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_yuvraj17__Llama3-8B-SuperNova-Spectrum-dare_ties)
|
282 |
|