Upload README.md with huggingface_hub

README.md

@@ -0,0 +1,42 @@
+---
+language:
+- en
+license: apache-2.0
+library_name: transformers
+tags:
+- text-generation-inference
+- transformers
+- unsloth
+- mistral
+- trl
+- not-for-all-audiences
+- image-text-text
+- audio-text-text
+- document-text-text
+- multimodal
+- llava
+- llama-cpp
+base_model: LeroyDyer/Mixtral_AI_Cyber_1.0
+metrics:
+- accuracy
+- bertscore
+- bleurt
+- code_eval
+---
+
+# LeroyDyer/Mixtral_AI_MultiToken-Q4_K_M-GGUF
+This model was converted to GGUF format from [`LeroyDyer/Mixtral_AI_MultiToken`](https://huggingface.co/LeroyDyer/Mixtral_AI_MultiToken) using llama.cpp.
+Refer to the [original model card](https://huggingface.co/LeroyDyer/Mixtral_AI_MultiToken) for more details on the model.
+## Use with llama.cpp
+
+```bash
+brew install ggerganov/ggerganov/llama.cpp
+```
+
+```bash
+llama-cli --hf-repo LeroyDyer/Mixtral_AI_MultiToken-Q4_K_M-GGUF --model mixtral_ai_multitoken.Q4_K_M.gguf -p "The meaning to life and the universe is "
+```
+
+```bash
+llama-server --hf-repo LeroyDyer/Mixtral_AI_MultiToken-Q4_K_M-GGUF --model mixtral_ai_multitoken.Q4_K_M.gguf -c 2048
+```