Update README.md

README.md

@@ -7,16 +7,33 @@ Merge of two Solar-10.7B instruct finetunes.
 
 ![solar](solar.png)
 
-## 🌟 Usage 
-
 
 ## 🌅 Code Example
 
-TODO
+```python
+import torch
+from transformers import AutoModelForCausalLM, AutoTokenizer
+
+tokenizer = AutoTokenizer.from_pretrained("macadeliccc/SOLAR-math-2x10.7b",load_in_4bit=True)
+model = AutoModelForCausalLM.from_pretrained(
+    "macadeliccc/SOLAR-math-2x10.7b",
+    device_map="auto",
+    torch_dtype=torch.float16,
+)
+
+conversation = [ {'role': 'user', 'content': 'A rectangle has a length that is twice its width and its area is 50 square meters. Find the dimensions of the rectangle.'} ] 
+
+prompt = tokenizer.apply_chat_template(conversation, tokenize=False, add_generation_prompt=True)
+
+inputs = tokenizer(prompt, return_tensors="pt").to(model.device) 
+outputs = model.generate(**inputs, use_cache=True, max_length=4096)
+output_text = tokenizer.decode(outputs[0]) 
+print(output_text)
+```
 
 ## Evaluations 
 
-model is currently experimental
+model is currently experimental and was evaluated in 4-bit
 
 |    Tasks    |Version|Filter|n-shot| Metric |Value |   |Stderr|
 |-------------|-------|------|-----:|--------|-----:|---|-----:|