Commit
•
c1694c1
1
Parent(s):
fc73400
Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,14 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Methame 7B
|
| 2 |
+
|
| 3 |
+
Using https://huggingface.co/TehVenom/Metharme-7b-Merged-Safetensors/ as the base (and included here)
|
| 4 |
+
Quanted on a Google Colab
|
| 5 |
+
|
| 6 |
+
Act-order and True-Sequential
|
| 7 |
+
C4: 7.8935709
|
| 8 |
+
Wiki2: 6.309680939
|
| 9 |
+
PTB:46.60740662
|
| 10 |
+
|
| 11 |
+
True-Sequential Groupsize 32
|
| 12 |
+
C4: 8.104910851
|
| 13 |
+
Wiki2: 7.025843143
|
| 14 |
+
PTB:48.19175339
|