Upload 2 files

README.md

@@ -0,0 +1,27 @@
+---
+license: apache-2.0
+pipeline_tag: text-generation
+tags:
+- finetuned
+inference: true
+base_model: mistralai/Mistral-7B-Instruct-v0.2
+model_creator: Mistral AI_
+model_name: Mistral 7B Instruct v0.2
+model_type: mistral
+prompt_template: '<s>[INST] {prompt} [/INST]
+  '
+quantized_by: wenqiglantz
+---
+
+# Mistral 7B Instruct v0.2 - GGUF
+
+This is a quantized model for `mistralai/Mistral-7B-Instruct-v0.2`. Two quantization methods were used:
+- Q5_K_M: 5-bit, preserves most of the model's performance
+- Q4_K_M: 4-bit, smaller footprints and saves more memory
+  
+<!-- description start -->
+## Description
+
+This repo contains GGUF format model files for [Mistral AI_'s Mistral 7B Instruct v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2).
+
+This model was quantized in Google Colab.

config.json

@@ -0,0 +1,3 @@
+{
+    "model_type": "mistral"
+}