Update README.md

README.md

@@ -3,11 +3,16 @@ library_name: transformers
 tags: []
 ---
 
-# Model Card for Model ID
+# boreas-10_7b-v1
 
-<!-- Provide a quick summary of what the model is/does. -->
+This is the result of step 2 of the upscaling of [Boreas-7B](https://huggingface.co/yhavinga/Boreas-7B) with [mergekit](https://github.com/cg123/mergekit).
+It is trying to reproduce the upscaling described in the [SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-Scaling](https://arxiv.org/abs/2312.15166)
+paper.
+This model is the result after step 2 from the figure below:
 
+![SOLAR 10.7B Depth up scaling](img_2.png)
 
+The model was continuously pretrained on a mix of Dutch and English for 20B tokens.
 
 ## Model Details