Update README.md

README.md

@@ -1,4 +1,21 @@
-Commands to make this:
+This is the Q3_K_M GGUF port of the [lightblue/Karasu-Mixtral-8x22B-v0.1](https://huggingface.co/lightblue/Karasu-Mixtral-8x22B-v0.1) model.
+
+
+### How to use
+
+The easiest way to run this would be to download [LM Studio](https://lmstudio.ai/) and search for this model on the search bar.
+
+Other ways to run this directly are using the llama.cpp package.
+
+```bash
+git clone https://github.com/ggerganov/llama.cpp
+cd llama.cpp
+make
+huggingface-cli download lightblue/Karasu-Mixtral-8x22B-v0.1-gguf  --local-dir /some/folder/
+./main -m /some/folder/Karasu-Mixtral-8x22B-v0.1-Q3_K_M-00001-of-00005.gguf -p "<s>[INST] Tell me a really funny joke. No puns! [/INST]" -n 256 -e
+```
+
+### Commands to make this:
 
 ```bash
 cd llama.cpp