Update README.md
Browse files
README.md
CHANGED
@@ -9,10 +9,19 @@ pipeline_tag: text-generation
|
|
9 |
tags:
|
10 |
- chat
|
11 |
---
|
12 |
-
|
13 |
## This repo contains EXL2 quants of the model. If you need the original weights, please find them [here](https://huggingface.co/anthracite-org/magnum-32b-v1).
|
14 |
## Base repo only contains the measurement file, see revisions for your quant of choice.
|
15 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
16 |
This is the second in a series of models designed to replicate the prose quality of the Claude 3 models, specifically Sonnet and Opus. This model is fine-tuned on top of [Qwen1.5 32B](https://huggingface.co/Qwen/Qwen1.5-32B).
|
17 |
|
18 |
|
|
|
9 |
tags:
|
10 |
- chat
|
11 |
---
|
12 |
+
|
13 |
## This repo contains EXL2 quants of the model. If you need the original weights, please find them [here](https://huggingface.co/anthracite-org/magnum-32b-v1).
|
14 |
## Base repo only contains the measurement file, see revisions for your quant of choice.
|
15 |
|
16 |
+
- [measurement.json](https://huggingface.co/anthracite-org/magnum-32b-v1-exl2/tree/main)
|
17 |
+
- [3.0bpw](https://huggingface.co/anthracite-org/magnum-32b-v1-exl2/tree/3.0bpw)
|
18 |
+
- [4.0bpw](https://huggingface.co/anthracite-org/magnum-32b-v1-exl2/tree/4.0bpw)
|
19 |
+
- [5.0bpw](https://huggingface.co/anthracite-org/magnum-32b-v1-exl2/tree/5.0bpw)
|
20 |
+
- [6.0bpw](https://huggingface.co/anthracite-org/magnum-32b-v1-exl2/tree/6.0bpw) (uploading soon)
|
21 |
+
- [8.0bpw](https://huggingface.co/anthracite-org/magnum-32b-v1-exl2/tree/8.0bpw) (uploading soon)
|
22 |
+
|
23 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/635567189c72a7e742f1419c/PK7xRSd18Du0bX-w_t-9c.png)
|
24 |
+
|
25 |
This is the second in a series of models designed to replicate the prose quality of the Claude 3 models, specifically Sonnet and Opus. This model is fine-tuned on top of [Qwen1.5 32B](https://huggingface.co/Qwen/Qwen1.5-32B).
|
26 |
|
27 |
|