File size: 329 Bytes
c1694c1
 
 
 
 
9335867
 
 
 
c1694c1
9335867
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
Methame 7B 

Using https://huggingface.co/TehVenom/Metharme-7b-Merged-Safetensors/ as the base (and included here)
Quanted on a Google Colab 

Act-order and True-Sequential ||
C4: 7.8935709 ||
Wiki2: 6.309680939 ||
PTB: 46.60740662 ||

True-Sequential Groupsize 32 ||
C4: 8.104910851 ||
Wiki2: 7.025843143 ||
PTB: 48.19175339 ||