concedo's picture
Create README.md
bd12719
This contains GGML quants for [PygmalionAI/pygmalion-6b](https://huggingface.co/PygmalionAI/pygmalion-6b), made for use in KoboldCPP.
It contains multiple versions, please download the [ggjtv3](https://huggingface.co/concedo/pygmalion-6bv3-ggml-ggjt/blob/main/pygmalion-6b-v3-ggjtv3-q4_0.bin) version for best results
[You can get KoboldCPP here](https://github.com/LostRuins/koboldcpp/releases/latest)