Update README.md
Browse files
README.md
CHANGED
|
@@ -242,6 +242,9 @@ In LM-Studio, simply select the ChatML Prefix on the settings side pane:
|
|
| 242 |
|
| 243 |
# Quantized Models:
|
| 244 |
|
| 245 |
-
|
|
|
|
|
|
|
|
|
|
| 246 |
|
| 247 |
[<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
|
|
|
|
| 242 |
|
| 243 |
# Quantized Models:
|
| 244 |
|
| 245 |
+
GGUF: https://huggingface.co/TheBloke/OpenHermes-2.5-Mistral-7B-GGUF
|
| 246 |
+
GPTQ: https://huggingface.co/TheBloke/OpenHermes-2.5-Mistral-7B-GPTQ
|
| 247 |
+
AWQ: https://huggingface.co/TheBloke/OpenHermes-2.5-Mistral-7B-AWQ
|
| 248 |
+
EXL2: https://huggingface.co/bartowski/OpenHermes-2.5-Mistral-7B-exl2
|
| 249 |
|
| 250 |
[<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
|