Add exllamav2 quant link (#5)

- Add exllamav2 quant link (cdec4919e0aabf8f00f75485f81583c7470140f8)


Co-authored-by: Bartowski <bartowski@users.noreply.huggingface.co>

README.md

@@ -71,4 +71,8 @@ Hercules-3.0-Mistral-7B is fine-tuned from the following sources:
 - No model parameters were frozen.
 - This model was trained on OpenAI's ChatML prompt format. Because this model has function calling capabilities, the prompt format is slightly different, here's what it would look like: ```<|im_start|>system\n{message}<|im_end|>\n<|im_start|>user\n{user message}<|im_end|>\n<|im_start|>call\n{function call message}<|im_end|>\n<|im_start|>function\n{function response message}<|im_end|>\n<|im_start|>assistant\n{assistant message}</s>```
 
-This model was fine-tuned using the TPU-Alignment repository. https://github.com/Locutusque/TPU-Alignment
+This model was fine-tuned using the TPU-Alignment repository. https://github.com/Locutusque/TPU-Alignment
+
+# Quants
+
+ExLlamaV2 by bartowski https://huggingface.co/bartowski/Hercules-3.0-Mistral-7B-exl2