Update README.md
Browse files
README.md
CHANGED
|
@@ -15,7 +15,7 @@ This is a merge of pre-trained language models created using [mergekit](https://
|
|
| 15 |
## Merge Details
|
| 16 |
### Merge Method
|
| 17 |
|
| 18 |
-
This model was merged using the passthrough merge method.
|
| 19 |
|
| 20 |
### Models Merged
|
| 21 |
|
|
|
|
| 15 |
## Merge Details
|
| 16 |
### Merge Method
|
| 17 |
|
| 18 |
+
This model was merged using the passthrough merge method. Every layer is doubled in order, from Qwen/Qwen2.5-72B-Instruct and Qwen/Qwen2.5-Math-72B, alternating which model is adding a layer and the MLP layers + 2 output layers only taken from the instruct model, creating 142B parameters. No additional fine-tune has been done in this merged model.
|
| 19 |
|
| 20 |
### Models Merged
|
| 21 |
|