Update README.md
Browse files
README.md
CHANGED
|
@@ -32,10 +32,10 @@ This run is only for development purposes, since merging 2 identical models does
|
|
| 32 |
* [mlabonne's phixtral](https://huggingface.co/mlabonne/phixtral-4x2_8) where I adapted the inference code to Phi3's architecture.
|
| 33 |
* [mergekit](https://github.com/cg123/mergekit) code which I tweaked to merge Phi3s
|
| 34 |
|
| 35 |
-
All of these will be published once I get a chance to refactor them to work flawlessly.
|
| 36 |
|
| 37 |
These have been merged using `cheap_embed` where each model is assigned a vector representation of words - such as experts for scientific work, reasoning, math etc.
|
| 38 |
|
|
|
|
| 39 |
|
| 40 |
|
| 41 |
## 🧩 Configuration
|
|
|
|
| 32 |
* [mlabonne's phixtral](https://huggingface.co/mlabonne/phixtral-4x2_8) where I adapted the inference code to Phi3's architecture.
|
| 33 |
* [mergekit](https://github.com/cg123/mergekit) code which I tweaked to merge Phi3s
|
| 34 |
|
|
|
|
| 35 |
|
| 36 |
These have been merged using `cheap_embed` where each model is assigned a vector representation of words - such as experts for scientific work, reasoning, math etc.
|
| 37 |
|
| 38 |
+
Try your own in the link above !
|
| 39 |
|
| 40 |
|
| 41 |
## 🧩 Configuration
|