| 4-bit GPTQ quantization of [VicUnlocked-alpaca-30b](https://huggingface.co/Aeala/VicUnlocked-alpaca-30b) | |
| **Important Note**: While this is trained on a cleaned ShareGPT dataset like Vicuna used, this was trained in the *Alpaca* format, so prompting should be something like: | |
| ``` | |
| ### Instruction: | |
| <prompt> (without the <>) | |
| ### Response: | |
| ``` |