Update README.md

README.md

@@ -34,6 +34,33 @@ will report soon
 
 `garage-bAInd/Platypus2-70B` was instruction fine-tuned using gptq on 2 L40 48GB. 
 
+## How to Get Started with the Model
+
+Use the code sample provided in the original post to interact with the model.
+```python
+from transformers import AutoModelForCausalLM, AutoTokenizer
+
+model_id = "malhajar/Platypus2-70B-instruct-4bit-gptq"
+model = AutoGPTQForCausalLM.from_quantized(model_id,inject_fused_attention=False,
+        use_safetensors=True,
+        trust_remote_code=False,
+        use_triton=False,
+        quantize_config=None)
+
+tokenizer = AutoTokenizer.from_pretrained(model_id)
+
+question: "Who was the first person to walk on the moon?"
+# For generating a response
+prompt = '''        ### Instruction:
+            {question} 
+
+        ### Response:'''
+input_ids = tokenizer(prompt, return_tensors="pt").input_ids
+output = model.generate(input_ids)
+response = tokenizer.decode(output[0])
+
+print(response)
+```
 
 ### Citations
 ```bibtex