Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -51,12 +51,19 @@ Below are the perplexity scores for the EXL2 models. A lower score is better.
|
|
51 |
| 3.0 | 5.2050 | [turboderp](https://huggingface.co/turboderp/command-r-plus-103B-exl2) |
|
52 |
| 2.5 | 5.6681 | [turboderp](https://huggingface.co/turboderp/command-r-plus-103B-exl2) |
|
53 |
|
|
|
54 |
|
55 |
## EQ Bench
|
56 |
|
57 |
Here are the EQ Bench scores for the EXL2 quants using Alpaca, ChatML, Command-R and Command-R-Plus prompt templates. A higher score is better.
|
58 |
|
59 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
60 |
|
61 |
### Command-R-Plus Template
|
62 |
|
|
|
51 |
| 3.0 | 5.2050 | [turboderp](https://huggingface.co/turboderp/command-r-plus-103B-exl2) |
|
52 |
| 2.5 | 5.6681 | [turboderp](https://huggingface.co/turboderp/command-r-plus-103B-exl2) |
|
53 |
|
54 |
+
_TODO:_ Dracones quant perplexity scores being worked on.
|
55 |
|
56 |
## EQ Bench
|
57 |
|
58 |
Here are the EQ Bench scores for the EXL2 quants using Alpaca, ChatML, Command-R and Command-R-Plus prompt templates. A higher score is better.
|
59 |
|
60 |
+
| Quant Size | Alpaca | ChatML | Command-R | Command-R-Plus |
|
61 |
+
|------------|--------|--------|--------|--------|
|
62 |
+
| 6.0 | 70.77 | 62.58 | 75.81 | 74.95 |
|
63 |
+
| 5.0 | 69.51 | 63.94 | 74.92 | 75.28 |
|
64 |
+
|
65 |
+
|
66 |
+
_TODO:_ EQ Bench scores being worked on.
|
67 |
|
68 |
### Command-R-Plus Template
|
69 |
|