Methame 7B | |
Using https://huggingface.co/TehVenom/Metharme-7b-Merged-Safetensors/ as the base (and included here) | |
Quanted on a Google Colab | |
Act-order and True-Sequential || | |
C4: 7.8935709 || | |
Wiki2: 6.309680939 || | |
PTB: 46.60740662 || | |
True-Sequential Groupsize 32 || | |
C4: 8.104910851 || | |
Wiki2: 7.025843143 || | |
PTB: 48.19175339 || | |