Update README.md
Browse files
README.md
CHANGED
@@ -9,6 +9,15 @@ base_model:
|
|
9 |
- anthracite-org/magnum-v2.5-12b-kto
|
10 |
- nbeerbower/mistral-nemo-bophades-12B
|
11 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
12 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6303fa71fc783bfc7443e7ae/qRsB-uefbKKrAqxknbWtN.png)
|
13 |
|
14 |
|
|
|
9 |
- anthracite-org/magnum-v2.5-12b-kto
|
10 |
- nbeerbower/mistral-nemo-bophades-12B
|
11 |
---
|
12 |
+
Mostly quanting this because I want to see how it performs.
|
13 |
+
|
14 |
+
[This is the 4bpw EXL2 quant of this model. For the original model, go here.](https://huggingface.co/Luni/StarDust-12b-v1)
|
15 |
+
<br>
|
16 |
+
[For the 8bpw version, go here.](https://huggingface.co/Statuo/Stardust-12b-MN-EXL2-8bpw)
|
17 |
+
<br>
|
18 |
+
[For the 6bpw version, go here](https://huggingface.co/Statuo/Stardust-12b-MN-EXL2-6bpw)
|
19 |
+
<br>
|
20 |
+
|
21 |
![image/png](https://cdn-uploads.huggingface.co/production/uploads/6303fa71fc783bfc7443e7ae/qRsB-uefbKKrAqxknbWtN.png)
|
22 |
|
23 |
|